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PREFACE 



Expanded prograjos of vocational and technical education, increased funds 
for research and development, rapid changes in technology, educational innova- 
tions, and new orientations and relationships are but a few of the many factors 
which eii^hasize the need for increased quality and quantity in our research and 
development efforts. One of the critical considerations in our expanded efforts 
is the administration of research. It was the broad purpose of this seminar to 
focus on those administrat3.on aspects which facilitate improved expanded 
programs of research and development. Admittedly, a seminar of such brief 
duration can only scratch the surface. We also recognize that many worthwh.ile 
ideas and suggestions developed during the seminar deliberations "fell between 
the chairs" and were not captured in this report. However, we believe the 
papers presented by the ''onsultants will be of value to the participants and 
other research workers and administrators who were not able to attend. 

This Vocational Education Research Seminar was one of four conducted in 
cooperation with the American Vocational Association Research Committee, the 
Occupational Research and Planning of the U. S. Office of Education, and the 
host institutions . Other research seminars were conducted at the University 
of Minnesota, the University of Nebraska, and Michigan State University. 



As .seminar director, I would like to acknowledge the assistance and 
cooperation of personnel in Occupational Research and Planning in the Vocational 
and Technical Education Division of the U. S. Office of Education; members of 
the Program Planning Committee at The Ohio State University; Dr. Rupert Evans, 
Chairman of the American Vocational Association Research Committee; and 
Dr. William JohJi Schill, Coordinator of the Vocational Education Research 
Seminars this year, both of The University of Illinois. Special thanks is 
due the capable consulting staff for their varied and valuable contributions 
to the seminar. One of the strengths of the seminar was the varied background 
and perspective of the participants. Their enthusiasm, interest, and partici- 
pation contributed materially to the seminar outcomes. 



Robert E. Taylor 
Director 
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3 . To clarify key individual and organizational roles and 
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5. To develop an understanding of the dynamics of planned change 
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6. To develop empathy and support for research and development 
in vocational education^ 
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THE ROLE OF RESEARCH AND DEVELOHvffiNT IN VOCATIONAL EDUCATION 

by 

Henry M. Brickell 
Assistant Superintendent 
Manhasset Public Schools 
Manhasset, New York 



There are a number of steps in the process of inventing and diffusing innovations 
in any field of human endeavor- -me ui cine, agriculture, industry, education -any field. 
What goes on at one stage of the research and development process is quite different 
from vrhat goes on at another. In fact, the circ-jmstances which are correct for any one 
of them are essentially wrong for all the others. The purposes are different; the 
people are different; the costs j the signs of excellence and the measures of success 
for the several stages all are different. Inasmuch as those differences cannot be 
reconciled, the stages cannot be telescoped or combined. Moreover, since each one 
must grow out of the preceding (in a carefully-planned program) they must occur in a 
certain sequence over a period, of time. Their order cannot be changed,. Furthermore, 
most people prefer to work in one stage and find working in the others uncomfortable 
if not distasteful. 

Those are my propositions to you. 

It ought not be necessary to cover this ground, with you who are experts in 
vocational education because you are all students of agriculture and. industry. Those 
two fields (along with medicine, business, and the military) offer the most compelling 
proof of what a serious program of research and development can accomplish. I can d.o 
little more than call sharply to your attention what you already know but perhaps have 
not yet applied, to your work as educators. 

Franlcly, if you were not educators it would, hardly be necessary. But since you 
are, I will pretend that you are as innocent of research and development as the 
remainder of the profession and will even presume to telj. you something about 
agr i culture . 

Most of us who have written about research and d.evelppment in education have 
recognized, several stages along a line of activity. All of us tend, to put something 
called basic research over toward the early end, something called development along in 
the jaiddle, and something called d emonstration over toward, the late end. Beyond that 
modest amount of agreement, however, we cannot seem to go. We all cut the line at 
different places a:id use all sorts of names to label the segments. 

It is well worth noting that the man who likes to work at a particular stage 
carefully slices it up into several substages and names each one. I am reminded of 
the map showing the USA as seen by Ohioans --Steubenville on the Atlantic, Dayton on 



EDITOR’S NOTE. Dr. Brickell preceded his paper with comments based on his 
experiences reported, in the publication, Organizing New York State for Educational 
Change. See pages 23-29 of an article from T heory Into Practice , Vol. I, No. 2, April, 
1 9 - 0 ^,’” "which capsules these experiences and observations. 
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the Pacific, and Cincinnati on the Gulf. This pheonomenon is worth your attention 
because the people whose work you administer are likely to be myopic Ohioans about 
their own work. They may show little, if any, interest in the work of men at other 
stages. Unless you yourself can keep the entire research and development spectrum 
in view, the more able and energetic of the men who work for you will inevitably 
lead you to over invest in their favorite stage. 

Last week in Washington. as a panelist for one of the research and development 
programs I read a proposal from an extraordinarily able group of researchers who 
enjoy working together. They proposed to spend many weeks and much money getting 
together to plan what to do, a little time working with school people persuading 
them to do it, and. many months and much more money evaluating the effect of their 
work on the schools. Like almost every multi-stage proposal I have ever read, it 
ballooned out at the proposers’ points of special interest, then deflated at the 
others. That particular proposal was dumbbell -shaped. 

Because the names of the several stages are not worth arguing about and because 
the smaller divisions are difficult to distinguish, I will simply number the major 
steps in order Some of che names commonly used to label various stages are shown 
below the line in a rough sequence from left to light. (See attached chart titled; 

A Research and Development Sequence on page 22). 

STAGE I - INQUIRING INTO THE WAY THINGS AEE . The ideal circumstances for 
Stage I are: detachment from any specific or immediate problem, the absence of a 

timetable, and no expectations except that knowledge will be produced. (More about 
the circumstances later.) 

The whole process of inventing and diffusing innovations in any field should, 
begin with an understanding of what the world is m.ade of and how it is put together. 

In the human enterprise we know as vocational ed.ucators, we want to start by 
understanding the circumstances, processes, and effects of learning to work. We 
want to know why man works- -the economic, political, social, and ego-related 
significance of it to him. We want to know the psychological effect of unemploy- 
ment. We want to know how girls choose careers. We want to know how factory work 
was represented in 19th Century English novels. We want to know the relation between 
intelligence and manual dexterity. We want to know what leads to success or failure 
on the job. We want to know which old jobs will disappear, which new ones will 
emerge. We want to know the salaries paid to refrigeration maintenance men' during 
their first three years of employment. We want to know how many boys cut electronics 
class at Southwest Tech the day afte'^ Thanksgiving last year. Throughout all this, 
we would especially like to knov; the relationships of cause and effect so that we 
can deliberately control events in the future. 

You can see that some of this information is more "basic" than the rest. That 
is, it explains more. You can also see that the information gathered will be "use- 
less" in and of itself. It will remain "useless" until someone takes it and says, 
in effect, "Well, if that's the way things work, how could I make a particular thing 
happen? Wow if I were to take ..." With that thought, he has moved across the 
line from Stage I into Stage II. 
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STAGE II ~ CREATING A PROCEDUEE FOR GETTING SOMETHING DOI3E . The ideal circumstances 
for S'cage II are ones of artifici^ enrichraent and extraordinary freedom. (More about 
that later.) 



In Stage II a goal is set and a procedure is devised to achieve it. The planner 
does not have to know anything whatever about Stage I. That is, we can have invention 
without research , engineering without physics. But you can see that a man can design 
better if he knows the properties of his materials in advance. 

In vocational education, Stage II is the translation of what is known about learning 
vocations into progr^s for teaching vocations. It is the creation of teaching equip- 
ment, teaching materials, teaching schedules, and teaching procedures. If the resulting 
program is to be exported outside the original invention setting, it must first be fully 
formulated, clearly described, and accompanied by all the equipment and materials (books, 
films, teachers' manuals, pupil examinations ) needed for its use. If this is not done, 
an exportable instructional program has not yet been invented and it cannot possibly be 
moved into Stage III. 

STAGE - III DETERICENING WIiAT A PROCEDURE WILL DO . The ideal conditions for 
Stage III are those which are controlled whenever possible and closely observed when 
control is not possible. (More about that later.) 

In Stage III we find out what the newly-devised, procedure is good for -if anything-- 
and what is costs to use. We compare its effectiveness and efficiency to that of other 
procedures which already exist and have the same goals. 

Here we are not interested, in whether it will grow in the greenhouse or tick in 
the laboratory. Since we are checking it out for possible widespread use, we test it 
^der all kinds of circumstances, exposing it to the risks of all weather conditions, 
indifferent care, and. ordinary people. 

In ^vocational education. Stage III means actu.al use of the program in the whole 
range of school classrooms with all kinds of teachers and. all sorts of students. At 
the end, we want to be able to say to the prospective user: "If you have these kinds 

of socio-economic conditions in your community, and this kind of teacher in your school, 
and. if your students are thus and your goals are these, and if you can acquire the 
following equipment and materials and use them as indicated, then this particular 
procedure will do such and. such a thing for you." 

When we can say that about a program, it is read.y for Stage IV. 

STAGE IV • MOVING A PROCEDURE IHTO GENERAL USE . The ideal conditions for Stage IV 
provid.e for the d.is semination of information; the d.emonstration of the proven proced.ure 
in natural, garden-variety settings; the persuad.ing of administrators; and. the training 
of teachers. (More about that later.) 

In^Stage IV the new procedure is moved out of the evaluation phase and installed, 
in the field, settings for which it has been proven useful. 

It is important that what is spread, be an authentic version of vrhat was invented, 
in Stage II and. proven in Stage III. It is not unusual to find, that field settings are 
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not yet equipped to use an innovation. If they cannot be properly equipped, the 
innovation cannot be spread. Moreover, once a new program has been installed,, it must 
be maintained or it will tend in time to lose its distinctiveness and fall in quality. 

The purpose of Stage IV activity is not to gain new knowledge, not to develop new 
procedures, and not to evaluate them. The purpose is to spread what has been proven 
superior. 

A Closer Look at the Several Stages. 



The most striking feature of the research and development patterns in other fields 
is the existence of separate agencies for different functions. The distinctions 
between the several stages is perhaps clearest in agriculture, where it took fifty 
years of trial and error to discover the differences and get organized to deal with 
them. (Pxease forgive me while I run a bucket of coals up to Newcastle.) 

In 1862, Federal legislation authorized, the creation of colleges of agriculture as 
part of the land grant institutions established under the Morrill Act. (You will 
recognize this as a Stage IV activity, intended to reach pre-service farmers.) In 
1887, twenty- five years later, the Hatch Act created agricultural experiment stations 
to discover something definitive for the colleges of agriculture to teach. (This was 
primarily to take care of Stage III and Stage II, with minor attention to Stage I.) 

I would estimate that vocational education today is about where agriculture was 
in 1887. We are educating workers today fairly well and we can go on doing it, getting 
gradually better by swapping the practices we evolve through trial and error. But 
suddenly we are offered over $20 million a year to get better faster. 

For twenty-five years after the Hatch Act of l887j in ad.dition to underpinning 
the college curricula, the experiment stations tried to disseminate research findings 
directly to farmers. Issuing research reports was soon abandoned because (and here 
the analogy with education becomes irresistible) research men wrote increasingly 
esoteric reports addressed primarily to each other. The stations then tried three 
day institutes, traveling exhibits, bulletins, speeches, demonstrations at the 
stations- -the same kind of techniques we use tod.ay in educat.lpn. They failed for 
them as they have for us and for many of the sam^ reasons. As a consequence, the 
Smith-Lever Act in 1914 created the agricultural extension service to solve the 
special problem of disseminating innovations to farmers alread.y in service. Both 
the Morrill Act and the Hatch Act neglected this problem. (So does the Vocational 
Education Act of 1963? as I read it. I wonder whether it will take us twenty-five 
years to find that out . ) 

The Smith Lever Act completed the basic machinery of agricultural research and 
development- fifty years after it was begun. I note with great interest that it has 
not had to be significantly redesigned in the fifty years since. An impressive test 
of its adequacy. Permit me to oversimplify in describing how it works; 

Drawing upon basic research in agriculture itself and in the scientific fields 
which underlie it, the staff of an agricultural experiment station is free, for 
example, to develop (to invent or create) a new strain of seed. The ne\<f seed, is 
then tested on a wide variety of plots owned, leased or otherwise controlled by the 
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experiment station. During this evaluation period, the circumstances surrounding 
the growth of the seed are controlled where possible and are observed and recorded 
where control is impossible, as with rainfall. At the conclusion of a successful 
field test, staff members of the experiment station describe the results in research 
reports. The dissemination process then begins. An extension specialist translates 
the research into a practical plan for using the new seed strain. The county agent 
is then responsible for promoting the use of the new seed. He frequently starts by 
persuading one farmer to demonstrate its use on his own farm so that neighboring 
farmers can be brought in to observe the results. For the farmers who want to 
change, the agent supplies the necessary knowledge and offers his continuing help. 

Medicine and. industrial development offer parallel examples. 

Let us now examine each phase of research and development in education with 
greater care. The conditioners of success suggested here are offered as possible 
criteria for judging proposals. They are different at each stage, of course, and 
the differences should be carefully noted. Although the categories created here 
are an idealized conception, which will be followed, only rarely in the proposals 
you will receive, they can serve to help you- and the proposers -understand what 
they are driving at and whether they have the right horses for the task. 

STAGE I 



The best atmosphere for inquiring into the way things are is one in which 
highly capable men have been released to pursue their own interests and. are 
expected only to produce knowledge. There is, ideally, no goal in sight other 
than the discovery of information. There are no d.eadlines. There will be time 
to pursue at greater length whatever is discovered. The results do not have to 
draw the applause of other workers, get into the newspapers, or succeed in the 
marketplace . 

The men working at Stage I are not responsible for seeing that their work is 
translated into something useful at Stage II. In all likelihood, no Stage I study 
will lead directly to a Stage II product. In fact. Stage I studies will often lead 
to nothing whatever. What men discover at Stage I goes into the general fund of 
knovfledge generated by mankind.. There it may someday be drawn upon- -if anyone cares 
to do sc. 

For its part, Stage II activity will always dip into the whole pool of knowledge 
produced by Stage I and will not attempt to sustain itself on a trickle on informa- 
tion from a single Stage I source. In other words, it is neither reasonable nor 
necessary to expect all research inquiry to have immediate value. 

Indeed, it does not matter whether the possible implications of a Stage I study 
are too expensive', impractical, or otherwise unacceptable for operating vocational 
ed.ucation programs as we know them today. In fact, while the inquiry is in progress, 
any concern for the applicability of the findings can distract the researcher, narrow 
his effort, and hasten him to unjustified conclusions. 

Our failure to recognize the value of basic research and our reluctance in 
education to finance adequately the special circumstances needed for it -along with 
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our natural but premature eagerness to have the researcher translate his results into 
educational programs- -have prevented or damaged many basic research efforts. They have 
led some of our finest minds to try to convert their finding to practical use and to 
seek recognition through advertising them or to seek money for further research through 
selling their findings to schools. Such use of research talent, although understand- 
able, is wasteful. Fundamental progress stops while these men go out into the market- 
place. They should be supported to ^do what only they can do. We distract them to our 
loss. 



Stage I research does not. conclude with a set of instructions telling the reader 
what to do with the results It says simply, "The investigators note with interest 
that, within the limited scope of our inquiry, things seem to work about like this- • 
with such and such a degree of probability that we are correct." It is up to the 
reader to make what he can out of the knowledge offered to him. 



I might remind, you that the state legislatures and the Congress have not typically 
expected the men who staff the bureaus of the executive branch, to pursue knowledge in a 
lesisurely atmosphere of detachment without regard to its ultimate use. You may con- 
sider how much Stage I inquiry it is fair to expect from the men in state education 
departments . 



Much of the research into human behavior v/hich underlies- -or sho.ild underlie- 
vocational education programs is carried out not by vocational education specialists 
themselves, but by economists, sociologists, anthropologists, and psychologists. It 
will undoubtedly lie there, unused, unless sifting through it becomes a standard part 
of all Stage II activity. It is my opinion that future efforts to develop vocational 
ed.ucation programs should draw heavily upon Stage I research. I believe that the best 
designs will come from the conscious, deliberate, iJlanned translation of that research 
into programs for teaching. 



i 
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STAGE II 

The basic ingredients of a good invention setting are a richness of talent and. a 
.freedom to explore. At its best. Stage II provides for (l) a group of highly intelligent 
people, (2) a somewhat limited problem, (3) time to concentrate on a solution, (’-!■) ample 
money and resources, (5) freedom to try alinost anything, ( 6 ) the likelihood that the 
solution will be used, somewhere, and (7) the prospect of personal recognition if the 
problem is solved. The more artificial, enriched, and free the setting, the more distinc- 
tive the innovation it is likely to prod.uce. 

Freed.om is essential. The atmosphere and. the actuality of freedom must be 
deliberately created. 

The Atmosphere , I always did poorly as a boy on the match- stick puzzles in my 
comic books. I could, never move three matches and wind up with five squares ^ or what- 
ever. When I turned in frustration to the solution, it usually said something like; 
"Stand matches #4 and. on end and. lay #2 horizontally across the top. (We didn't 
say you had. to lay them flati)" I was always a 7 ictim of self-imposed restrictions. 

Most of us bring to any problem a set of limitations which are in us rather than in 
the problem. The technique of group "brainstorming" is governed by a set of rules 
meant to wipe out artificial limits- -you are to say whatever springs into your mind, 
you are encouraged, to stretch another man's unorthodox suggestion into something 
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really outlandish (the old-fashioned word for "way out") you are not to criticize 
anyone's idea no matter how wild, and so on. 

The Actuality . Beyond the matter of climate, you want the kind of exhilaration 
that comes when top management • says, "Men, we want a solution and. we don't care what' 
it Costs." The lifting of a monetary ceiling is a shorthand, way of promising equip- 
ment, consultant ad.vice, secretarial help, travel money, tryout schools- -whatever, 
and. this is important, whatever the inventors themselves think they need. 

I have traveled, occasionally among ed.ucation's Stage II hothouses --those 
especially -created, curriculum development settings blessed, with a favorable climate 
and. enriched soil. I usually check out the seven ingredients,! have suggested, to 
you here. Once I' met two biology teachers who had. been hired, by an ind.ustrial giant 
for the summer and. freed to pursue their own research on the DM molecule in the 
hope that they might come up with some techniques useful for teaching high school 
biology. They came out of their modern laboratory, past their technician's office, 
and into the paneled anteroom. We stood on the carpet, chatting about their travels 
in conjunction with the project; then I ticked, off the seven criteria and. asked, 
"Right or wrong?" 

"Wrong on one," said the older. "You don't need lavish resources." 

"You don't?" I said, looking around. 

"No,' he said, "The resources don’t have to be lavish. All that's necessary 
is that they give you everything you ask for." 

His remark is' a classic. It goes to the heart of the matter. For what would 
in any other circumstance be extravagant is in an invention setting a matter of 
simple necessity. 

The typical operating school does not provide a setting rich enough or free 
enough to generate new instructional programs. Faculties usually carry heavy 
responsibility for operating standard, programs. Often overburdened, with routine 
duties, they can rarely take their hands off the wheel of labor long enough to 
invent something better. 

The national curriculum studies sponsored, by the National Science Foundation's 
Course Content Improvement Section- -PSSC physics, SMSG mathematics, BSCS biology, 

CHEM and CBA chemistry-all sprang, without exception, from artificially created, 
enriched, free settings. They did not arise naturally from the workaday world. 

None of them would exist today if a large group of talented, men had not been paid 
and freed, to concentrate specifically on designing them. NSF spent about $1-| million 
to develop CBA chemistry, $6 million to develop PSSC physics, and. $8 million to 
develop SMSG mathematics. Those, by the way, are all Stage II costs; they do not 
include Stage IV costs, whi.:h in the case of PSSC have run an additional $8 million 
so far. Six million to develop PSSC, $8 million to spread, it. No wonder it is the 
success story of our time. 

Not all limitations are monetary. State education departments are notoriously 
prudential in outlook, and they have their regulations to prove it. The Federal funds 
which came to vocational education first with Smith-Hughes and subsequently with 
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other laws have---until the Vocational Education Act of 1963--been accompanied with 
highly prescriptive provisions . Regulation in any form, no matter how broad and no 
matter how well intended, always inhibits innovation. Suppose you requiie only the 
most general conditions--say that students be taught in a school building by college 
educated personnel at a per pupil cost of $400 per year or above. No government 
agency stops at that. But even if it did, the room for inventing new forms of voca- 
tional education would have been severely restricted. 

The five states involved, in the Ford -financed Western States Small Schools 
Project faced this problem head on 3 p years ago. They established five criteria for 
membership. The fifth, titled "Freedom to Experiment," requires that "all governing 
boards ( i.e. , state boards of education, boards of trustees, etc . ) of the state 
departments of education or institutions of higher learning must adopt a resolution 
that the project will not be obstructed by any regulations which might restrict or 
deter or in any way deny the free and unrestrained examination of methods and 
techniques specifically designed to assist in the development of higher quality of 
educational opportunity."^ I commend their fine example to you. Existing regula- 
tions ought to be suspended in Stage II while better methods are being sought. 

In summary, the Smith-Hughes and George-Barden Acts did not give us the con- 
tinuous cycle of innovation we must have in vocational education- -largely because, 
in my opinion, they did not call for the deliberate creation of Stage II seed.beds. 
The Act which brings us together today corrects that condition. What it takes for 
Stage II is bright people, a limited problem, time to work on it, lavish resources, 
maximum freedom, the probable use of the invention, and the promise of recognition 
for the inventors. To the best of my knowledge, if you omit any one of them, the 
resulting invention will be fragmentary or deformed. 

STAGE III 



At its best Stage III activity provides conditions in which the forces which 
might influence the success of the new approach being tested can be controlled, when 
possible and kept imder close surveillance when actual control is impossible. The 
detachment from practical affairs, which is an important feature of Stage I and the 
great freedom which must characterize Stage II, would be inappropriate and ultimately 
destructive in Stage III. 

Stage III calls for the systematic testing of a new instructional approach to 
find what it will accomplish under what conditions The empirical evaluation of 
programs by using them in many different schools und.er carefully controlled or 
closely observed conditions can be described as field testing . In the test, the 
novel- procedure must be used over a period of time and. its results compared, with 
the results of other proced.ures used under similar conditions. The process requires 
two restrictions: (l) procedures must not be changed in mid-stream; othen-zise it 



Colorado State Department of Ed.ucation, An Introduction to the Western States 
Small Schools Project, Colorado State Department of ^Education, Denver, p. 18. 
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will not be clear what is being evaluated, and (2) the circumstances in which the 
procedures are used must be kept comparable; otherv/ise it will not be clear what 
environmental conditions are determining the outcome. 

A broad field test is desirable because we know so little about the conditions 
which affect learning in school. New programs should be tested in situations so 
diverse that all the forces which play upon learning, even though unknown, will none- 
theless be present to influence the results. A program may prove satisfactory in 
moso schools "hile giving spectacular results in one particular setting and abysmal 
results in another. Only by extensive field testing can we avoid the error of 
labeling a program a success or a failure because it happened to be tried in a 
single circumstance where an unknown factor dictated the results. 

We are relatively unfamiliar with Stage III endeavors at the present time in 
education. Ordina.rily the step is skipped entirely and. we move directly from II to 
IV, disseminating raw, untested inventions. Many of our most talked-about and 
earnestly promoted innovations have yet to be carefully assessed- -instructional 
television, flexible scheduling, team teaching, non-grad.ed plans, programed 
instruction, and even the vmdely- respected NSF science and math courses mentioned 
earlier. The same situation appears to exist in vocational education. 

The field testing called for in Stage III is to be distinguished from the 
common use of field trials in Stage II. Field trials are often used to collect 
suggestions from teachers p's to how the course could be improved and to determine 
whether the course is workaole at all in a natural setting. All the NSF courses 
have had the benefit of field trials and were greatly modified, by them. But try- 
out for the purpose of redesign is not the same as testing to find whether a com- 
pleted program is effective and to ascertain where it should be used. It is this 
final step that we usually skip. 

Note also that field use is not the equivalent of field testing. Years of 
field use may prove only that a practice in vocational education is feasible--not 
necessarily that it is effective. It is revealing to observe that the degree to 
which a program has been carefully evaluated has nothing to do with its age. I 
daresay we have as little actual hard evidence about the effectiveness of work 
experience in distributive education as we have about the effectiveness of our 
new courses in computer technology. 

The evidence v/e seek from a thoroughly-planned, well-designed Stage III 
activity v/ill not come to us in any other way. It is not a natural occurence. 

It must be consciously planned for and men must be trained to do it . As many 
as twenty or thirty different schools should be used in a single test. The 
process may occasionally be concluded witriin one or two years, but will usually 
take longer because longitudinal studies will often be required. 

In the same way that Stage II development can proceed without the benefit 
of Stage I research. Stage III evaluation can be applied to any program no 
matter hov; it was developed. It is not necessary to wait until an innovation 
has been bred in the incubator recommended for Stage II. New approaches have 
been and. v/ill continue to be designed in all sorts of settings, including arx 
occasional local school system. They should be as eligible for field testing 
as any developed under more scientific conditions. 
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STAGE IV 



Like all eaj?lier phases, Stage IV has its own subordinate stages. The chief ones 
are: (l) acquainting schools with the existence of the new program, (2) persuading 

school administrators to adopt it, (3) malting certain the school acquires the necessary 
machinery and materials, and (4) teaching staff members how to conduct the prograxa. 

Clearly, Stage IV is not "research" and it is not "development" in the sense of 
creating something new. Yet any so-called research and development program which stops 
short of Stage IV may never touch a pupil in a classroom. The heavy work of research 
and development lies in moving proven new programs out into the field settings where 
they ought to be used. 

Innovations are not eagerly sought by ail schools. They do not flow automatically 
across the nation simply because they have merit. They can be urged from national plat- 
forms, attractively packaged, tested and found to be good., stamped. "Safe for human con- 
siimption’'--and still they may sit in the warehouse. 

I offer you my observations about Stage IV — my favorite term for it is dissemina - 
tion — as it appears to work in elementary and secondary ed.ucation generally and leave 
it to you to test them against your own experience in vocational ed.ucation. 

As Everett Rogers will und.oubted.ly tell you when he speaks later in the conference, 
it is one thing to be informed and another to be convinced. Knowing that something 
exists is only a first — and not very big--step in the successful adoption of an innova- 
tion. (This is one of the things it took agriculture twenty-five years to discover and 
the Smith -Lever Act to cure.) Furthermore, since we are discussing institutional 
adoptions rather than farming practices, keep in mind that the man to convince is the 
administrator located, at the control center of the institution we want to change. 

The most effective way to convince a school staff that it should, adopt a new 
program is to let it observe the successful new approach in action. Nothing persuades 
like a visit. Written descriptions of the new program, speeches about it and. research 
reports concerning it shcold all be regarded, as preliminary or supplementary to a visit . 

The innovation must be demonstrated under cond.itions which are not abnormal, 
artificial, or unreal! stic«-that is, not too different from the everyday circumstances 
in the observer’s own school and. community. 

The most persuasive demonstration consists of the continuing use of the new 
approach as a basic part of regular instruction in a normal school setting. Anything 
which smacks of a "performance" by extraordinary teachers working under artificial 
conditions for a limited time is likely to be unconvincing. The observer may express 
interest, but he cannot be certain the approach would work day and day out in the hands 
of the average teacher in his own school. 

After the visit, if the local school decides to take on the new program, it is 
essential that its staff be thoroughly educated in the professional skills necessary 
to carry it out. The development of those qualities in the staff requires far more 
elaborate steps than most schools even think of providing ordinarily. In the id.eal 
situation for re-education, the teacher of teachers knows more about the innovation 
than those he is re-educating an^ has h.iraself succeeded in using the program with 




chiidr6n« Th6 instruction r6ach6S simuitanaousiy all taacliars who should us6 th6 
innovation, extends over a long period of time, and is interspersed with actual 
classroom practice in using the innovation. 

Furthermore, turnover in local faculties is so high that re-education for an 
innovation must be available continuously to nev/ teachers entering the school, 
Adeqiiate arrangements for doing this locally are a]jnost non-existent, as you Icnow, 
Here is where state leadership directly or through intermediate units is essential. 

In summary, successful dissemination depends upon realistic demonstrations 
followed by intensive, continuing re-education. 

Let me conclude my observations about Stage IV with a comment about local 

Adaptation is v/idely recommended as superior to adoption. No doubt 
it is superior to the blind, slavish adoption of an ill-fitting innovation. But 
it has been my own observation that most local adaptations of programs developed 
outside are not a shrewd ingenious tailoring of the innovation to make it fit local 
needs. The final adaptation usually looks to me more like what they have left after 
they knocked the corners off getting it through the door. It appears to be the part 
they were actually able to get inside the school, given their shortcomings of space, 
time, equipment, materials, and trained personnel. I trust the point is apparent. 

A Fev/ Final Generalizations About the Research and Development Sequence . 

These final generalizations are based on my own observations and constitute 
my ovm views. I cannot guarantee their accuracy; I can culy say that they fit my 
experience. 

As one moves from Stage I thro-ijgh Stage IV, from basic research to the dissemi- 
nation of innovations, the following seems to be true: 

* One mcui working alone can accomplish less and less. 

* More and more people must be dealt with. 

* Costs rise sharply. 

* The value of a dollar diminishes. 

* The amount of hardware and materials needed goes up. 

* The average level of human talent goes dovm. 

* Sharpness of thinl^ing diminishes. 

* Quality of ideas tends to be diluted. 

* Ideas must begin to be pushed rather than left to be pulled from one stage 
to the next, 

* Facts unaided by emotion become le.ss persuasive. 
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* Emotion unenlightened by facts becomes more persuasive. 

« 

* Strategies of educational change must deal less with individual men and 
more with their institutions. 

Probably the most significant final generalization I can offer - and in some 
ways the most disturbing - is this; 

A mature program of research and development is one in which men are busily 
disseminating in Stage IV a set of innovations which are decidedly worse than those 
being tested in Stage III, which are themselves definitely inferior to those being 
invented in Stage II, which are themselves worse than they could have been if men 
ha-d only knoi-ni what they are no\r lea.rning in Stage I. Or to accentuate the positive, 
what is now being learned in Stage I will soon make what is new being invented in 
Stage II look primitive, even though present Stage II developments frankly look far 
superior to those being tested in Stage III, which are clearly better than what is 
now being spread in Stage IV, which has, of course, already been proven superior to 
what schools v:ere doing before. 

Responsibility for Manar^ing Research and Development . 

Certain agencies in education are better equipped to work at one stage than 
another in research and development. They are differently situated with respect 
to legal responsibility, organizational structure, tradition, values, viev^point, 
funds, and personnel. My view is that they should apply their strengths and not 
attempt to be all things to all men. 

You will certainly reject this vievr outright. At least my experience has been 
uniform on this point. In my ovm I96I study of educational change in New York State, 
for example, I wrote about the shortcomings of the state department, the school study 
councils, the teachers colleges, the laboratory schools, the commercial publishers, 
and everybody else. Af tervmrds , each told, me that I had, been wong about it but 
that there was a lot of truth in what I had said about the others. However, their 
opinions were identical on one point: Each organization felt that, properly financed, 
it co''uld almost single-handedly encompass the whole research and, developiment sequence. 
Most of them, of course, knew that Buffalo is on the Pacific. 

Quite honestly, I expect that you will go into your discussion groups later 
today and spend, most of the time explaining that your own agency is both responsible 
and. equipped to do the whole job. Nevertheless, I vrill propose that, as shovm on the 
chart titled, A Research and. Development Sequence , Stage I is especially suitable for 
universities and. research institutes; Stage II, for universities, research institutes, 
and. state agencies; Stage III, for state agencies; Stage IV for intermediate units and. 
local school systems . 

The reasons for this recommendation cannot be recounted, here today, but are care- 
fully presented in the report of my 196I New York study, along with detailed recom- 
mendations for administrative structure. I do not know enough about vocational educa- 
tion to know how precisely the structure will fit. To take but one example of an 
exception, it v/as quite evident that in New York State in I96I, local vocational agri- 
culture programs were well served in Stage IV I'dthout the benefit of intermediate 
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units- -probably because of the high quality of state personnel, their large number 

relative to the nuraber of local programs, and their tradition of aggressive field 
J .6 8.0.61* snip • 

You will discuss proper administrative structure throughout in this conference. 
^ only concern about structure is that if you ask an agency to stretch itself over a 
function not normal to it, it will be long on lip service and short on performance-- 
and It will not even laiow that it is cheating. 

^ iinal Point needs to be made: I speak here only of the management of the 

function, not of the p^ticipants . Local schools, for exaraple, will be participants 
in every stage, I through IV. > ^ 

^le Need, for a Planned Sequence of Research and Development 

A school, like anv other institution, tends to continue doing what it was 
es-cablished to do, holding itself relatively stable and resisting attempts at 
res-cructuring. There is a so'ond reason for this: Stability in the institutional 

structure makes for maximum output of the results that structure was designed to 
produce. Any change in the arrangement of its elements tends to cut down produc- 
tion, at least mitil new habit patterns are formed. 

There are two distinct groups of people who might be expected to call for 
change in an institution such as a school --those inside it and those outside of 
it. There is no question that, for reasons detailed at great length in the 
literature, the most powerful demands for change are generated outside an institu- 
tion rather than inside it. 

The case is no different with schools. They will be under external pressure 
to keep on modifying their vocational education programs as far into the future as 
^y man can see. The primary reason for a systematic program of research .and 
development is to see that the changes which are coming as a result of external 
pressures ---and they are coming, one way or another -to see that the changes are 

made on a rational basis, are good for students, and ultimately good for our 
society. 
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(Dr. Brickell's Comments Based On His Experiences Reported In The 
Publication, Organizing Nev York Stat e for Educational Cha nge) 



THE DYNAMICS OF EDUCATIONAL CHANGE^ 



Wliat causes schools to change the way they allocate teachers, time, space, or 
other resources? How is shifting to ungraded classes, programed instruction, tele- 
vision, team teaching, large- and small-group instruction, and the like, achieved 
within the institutional framework? Given an existing set of dynamics and statics, 
how can more innovations be stimulated, evaluated, and the best ones extended to 
other schools and school systems? 

To study the problem firsthand, in New York State, the writer visited, thirty- five 
local school systems of every complexion (one hund.red schools, fifteen hundred class- 
rooms), thirteen colleges and universities, the State Education Department, ten 
regional college -affiliated. school-stud.y councils, schools of medicine and agriculture 
and a variety of professional, commercial, and school-related, citizens' organizations. 
The discussion that follows is based upon the findings for oxie state. New York, but it 
has implications for scl:pol systems throughout the country. 



The Process of Change within Local Schools 

A school is a social institution in which someone teaches something to someone 
else with a method at a time in a place. The six major structural elements of the 
institution are teachers, subjects, students, methods, times, places. This study 
focused exclusively on programs which require significant shifts in the normal 
g^rangan ent of those institutional elements . The witer did. not investigate class- 
room practice --the behavior that the teacher is usually free to exhibit in his own 
classroom with his own pupils. It was found, that the public and the school board, 
the administrator, and the teacher exert varying degrees of influence in instituting 
broad ed.ucational changes . 

The Publi c and the Board . Parents, citizens' groups, and boards of ed.ucation 
^e not strong agents in determining the path of instructional innovation, but their 
influence is decisive when exerted. The public and the board are important sources 
of demands for new or better results , but not for specific instructional i nnovations, 
perhaps because they know little about teaching methods. However, if they do d.evelop 
a lively interest in a new type of program— foreign languages in the elementary school, 
ror example — that innovation is likely to appeax * 

The public and the board ordinarily do not inhibit the profession in introducing 
structural imovat ion. Factors such as mutual selection of each other by administrators 
and communities evid.ently cause public wishes to be absorbed into the schools so effec- 
tively that severe dislocations between the hopes of the profession and the ambitions 
of the commujiity are rare. Thus the public is not identifiable as a separate force. 



^Theory Into Practice , Vol. I, No. 2 , April, I962. 
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Administrator . Instruct ionaX innovations of th@ type studied are introduced 
by administrators— not by teachers. Even in the best of circumstances for the 
es^ression of new ideas— in schools where administrative authority is exercised with 
a light hand and faculty prerogative is strong— teachers seldom suggest distinctly 
new types of working patterns for themselves. 

The complexity of groiQ) decision-making and the difficulty of a peer group’s 
choosing among several attractive possibilities (or. more exactly, possibilities with 
different degrees of attractiveness for each member; are well known. The value of 
leadership and the uses of authority in such a situation are also well known. An 
administrator is powerful because he can marshsl the necessary authority, if not the 
necessary leadership, to precipitate a decision. He may not be, and frequently is 
not, the orig inal source of interest in a new type of program? but unless he gives 
it his attention and actively promotes its use, it will not come into being. 

The great significance of administrative initiative is heavily disguished. 
Phrases like "democratic administration^*' "the team approach," "shared decision- 
making," and "staff involvement" are commonplace. Behavior to match them is rare. 

The participation patterns in widespread use are very often little more than 
enabli^ arrangements, organized after an administrator has decided the genereO. 
direction (and in some cases the actual details) of an instructional change. The 
control center of the school, as things are managed today, is the administrator. 

Teacher. In the absence of administrative initiative, classroom teachers 
apparently can make only three types of Instructional change: 

1. Change in classroom practice— that is, any alteration in instructional 
procedure which a teacher can accomplish in his own classroom without disturbing 
the work of other teachers. 

2. Relocation of existing curriculum content— an activity which a group of 
teachers commonly initiates and can carry forward relatively unassisted so Icng as 
there is no administrative opposition. A typical example would be the relocating 
of arithmetic topics between the fourth and fifth grades to assure proper 
dovetailing . 

3. Introduction of single special courses at the high-school level- these are 
commonly terminal courses in a sequence. They are often begun at the initiative! of 
a teacher who has just returned frcmi (ui intensive learning experience, such as a 
summer institute. 



Introducing the Change and Evaluating It 

Professionai. suspicion about the value of innovations in other school systeas, 
and even about the sincerity of other innovators, is a widespread and serious 
inhibitor of educational change. Administrators and teachers suspect that many ne’.v 
prQgrams may. have been ooncobted" largely to gain recognition for their sponsors. 

The most persuasive experience a school person can have is to visit a successful 
new program and to observe it in action. Speeches, literature, research reports, and 
conversations with participants outside the actual instructional setting are interesting. 
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but relatively unconvincing. However, anything "abnormal," "unreal," or "arti- 
ficial" in the circumstances surrounding an observed program— that is, anything 
appreciably different from conditions in the visitor’s own school system— can rob 
a visit of persuasive effect. For this reason, people from a rural school district, 
for example, have little interest in visiting a wealthy suburb. 

Despite initial apathy or even opposition on the part of a number of teachers, 
new instructional programs can be successfully introduced. Faculty members 
ordinarily begin to prefer new methods within four months to a year after a novel 
program has been introduced, regardless of their very early reactions. It seems 
reasonable to believe that after teachers learn how to do the new ^ob, they feel 
competent and secure. 

Proposed innovations dften arouse feelings of inadequacy and uncertainty in 
teachers. These feelings ouould not be mistaken for outright resistance to the 
change: this is seldom the case. 

The hey to successful innovation is providing assistance to the teachers as 
they begin to implement the new approach. More new programs have been destroyed 
by inability than by reluctarjice. 

In evaluating instructional innovations, pupil reaction is usually considered 
sufficient as a criterion. In the eyes of the practitioner, no other evid.ence 
outweighs student reaction as a measure of success. More complex evaluative 
techniques are rarely used. Even if the normal operation of the school produces 
pertinent information, such as scores on standardized achievement tests, the data 
are inspected with interest but are almost never regarded as conclusive in and of 
themselves. For example, if achievement-test scores show little or no difference 
as a resuJ-t of the nev; procedure (which is what they usually shov;) but students 
nevertheless respond to the instruction with interest or enthusiasm, the method 
is judged to be superior to what was done before. 

Instructional changes are nearly always reported as resulting in improvement. 
Almost everj/thing new seems to work better. The witer's observations led him to 
conclude that the attention, encouragement, and recognition given to teachers by 
persons outside the classroom during the introduction of new programs are araong 
the strongest causes of their success. 

Class'>'’oom teachers normally work in such isolation that the kind of attentior 
provided by the principal and others during major instructional changes can scarcely 
fail to have an exhilarating effect. The "Hawthorne effect"— higher production 
stimulated by a change whioh does not alter the original resources — evidently goes 
hand in hand with educational innovation. 

The Role of Outside Institutions and Organizations 

A number of organisations outside the local school system attempt to influence 
innovations. They meet with mixed success. 

The State Education Department . Because the state education agency in New York 
is larger and more influential than that in most other states, observations concerning 
it may have limited applicability. The folloxdLng might fit a number of other state 
education departments : 
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The department both promotes and inhibits change. It encourages the adoption of 
innovations that it officially endorses, discourages the adoption of others. Depart- 
mental discouragement inhibits all but two types of schools- the slow-movers who never 
even reach the boundaries of state approval and the fast-movers who, in their own 
word s , "Don ' t ask . " 

The department has no adequate mechanism for encouraging experimentation along 
lines that it does not officially approve. Despite many recent moves to sponsor 
innovation, it is still essentially prudential in outlook and devotes much of its_ 
effort to regulatory activities. It is entirely too small to provide direct service 

to the schools. 

The Colleges and Universities . Except for their role in training teachers, 
which is universally regarded, as being of critical importance, the colleges and 
universities have little influence on instructional innovation in elementary and 
secondary schools. Very few of the local programs studied during the survey had. 
been suggested, planned, evaluated, or even observed by college personnel— on either 
a paid or voluntary basis. 

The colleges and universities are not well organized, to exert direct influence 
on elementary and secondary programs and, do not consider this to be one of their 
basic responsibilities. Institutions of higher learning are organized primarily to 
teach regular courses of predetermined, content and length. 

For instructional shifts of major scope, it is necessary to deal with the 
entire staff rather than with individual teachers. College courses designed, for a 
collection of individuals must tea.ch information and skills which will be useful in 
a variety of school settings. They cannot be directed narrowly toward, the needs of 
one particular system, the form in which they would, be most useful to a school 
system adopting a new instructional program. 

No one in the profession understands the necessity for continuous in-service 
education as well as the college personnel who are providing pre-service ed.ucation. 

Thev said quite frankly, "We do not pretend to turn out a finished, product. They 
assert that the colleges do not attempt to equip the prospective teacher with 
specific instructional techniques, but concentrate on developing a general profes- 
sional wisdom from which he can draw the specific techniques that he needs for any 
given task. Actual instruction in specific techniques was said, to be the respon- 
sibility of the schools which employ the college graduates — a responsibility which 
most local schools patently are unable to meet. 

Despite college disclaimers of any serious effort to teach specific techniques, 
the writer came away from the interviews with the strong impression that certain 
specific techniques are indeed taught but that they can be’better described as , 

"currently in vogue" rather than as "basic professional wisdom." These are exemplified 
by methods of using a textbook, makirjg lesson plans, and assigning homework. After 
close study, the writer concluded that teacher-education programs do not t,rain teachers 
in how to carry out new instructional processes until those processes are in general 

use . 



Professional Ass ociations . The professional associations are the most effective 
communicators, not primarily because of their publications and programs, but rather 
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because of the opportunities they provide for informal contact among individuals at 
meetings. (A talk with a trusted, friend who has himself experienced a new program 
is very close to an actual visit in its persuasive effect.) Notv/ithstanding their 
effectiveness compared, to other agencies, the communication which the associations 
provide is random, disjointed, overlapping, and. unfocused. 

College-Affiliated School Study Councils . The college-affiliated, school- 
study councils act primarily as communicators of information. They are rarely tied, 
in directly with the process of changing the instructional approaches used in their 
member schools. These councils are generally poorly financed and. weak in influence. 

The heart of the problem seems to be that the study councils are usually 
managed by college personnel interested, chiefly in discovering new information and 
paid, for by local school systems interested chiefly in learning to do in the best 
way what is already known. The result is an enterprise so underfinanced that it can 
perform neither function very well. 

Private Philanthropic Foundations . The great contribution of the private 
philanthropic foundations in education, as in other fields, is that they have 
created conditions under which able people could, be freed to concentrate at least 
temporarily on limited, fijinctiohs. Some promising new programs have resulted. 
Nonetheless, it is difficult for private foundations to promote the spread of any 
distinctive instructional approaches that they have sponsored becaise of the profes- 
sional suspicion aroused by any new approach, particularly one which is being 
actively advertised. 

Commercial Organizations . The commercial organizations, such as textbook 
publishers, are extremely powerful. When they promote an instructional change, a 
great wave of influence sweeps over the schools. On the other hand, once they 
begin to market a given product, they serve as powerful inhibitors of change because 
they seek volume d.istribution and repeated sales of the same product. 

All in all, the commercial organizations tend, to be a unifying influence over 
curriculiJLm content and instructional methods not only on the state-wide level, but 
nationally as well. They seem to hold the better schools and the better teachers 
short of the point they could reach, while taking poorer school systems and less 
capable teachers further than they would otherwise go. 

The Three Phases of Instructional Innovation 



The key conclusion of this study is that the design , the evaluation , and the 
dissemination of innovations are not at all the same. They are three distinctly 
different processes. The circumstances which are correct for any one of them are 
essentially wrong for the others. They cannot be reconciled. Moreover, most of 
the persons who work well in one phase do not work well in another. 

The hallmark of the ideal design setting is freedom ; the hallmark of the ideal 
evaluation setting is control ; the hallmark of the ideal demonstration setting is 
normality. 




30 



Phase 1; Design. The ideal circumstances for the design of an improved 
instructional approach are artificial, enriched^ and free . At their best, they 
provide a group of highly intelligent people, a somewhat limited problem, time to 
concentrate on a solution, ample money and resources, freedom to try almost any- 
thing, the likelihood that the solution will be used somewhere, and the prospect 
of personal recognition if the problem is solved.. The more artificial, enriched, 
and. free the setting, the more distinctive the innovation it is likely to produce. 

Phase 2; Evaluation. The ideal circumstances for the evaluation of a new 
instructional approach are controlled, closely observed, and unfree . At their % 
best, they provide conditions in which the forces that might influence the success 
of the nev7 approach can be controlled, when possible and. kept under close surveillance 
when actual control is impossible. The freedom which is essential in searching for 
a good design is destructive in making a good, evaluation . 

Phase 5: Dissemination. The ideal circumstances for the dissemination of a 

new approach through demonstration are those which are ordinary, unenriched, and 
normal . At their best, they are exactly like the everyday situations in the 
observer's own school and community. Anything which the observer co ild. label 
"abnormal” or "unrealistic" — such as the enriched, conditions necessary for good 
design or the controlled conditions necessary for proper evaluation — robs the 
observed program of persuasive effect. 

The most formidable block to instructional improvement today is that educa- 
tion — unlike medicine, agricult ire and industry — fails to distinguish the three 
phases of change: design, evaluation, and dissemination. The campus laboratory 

schools offer the most spectacular example of trying to put everything into one 
shell. They are expected, at the same time and. in a single setting, to invent new 
programs, to evaluate them, to demonstrate them for the pui*pose of persuading the 
public schools to do likewise, to show the best now- known ways to teach, and. to be 
a safe place for professors' youngsters to go to school. All these functions cannot 
of course be performed at one time in one setting. The campus schools respond by 
demonstrating the best known ways to teach because that function fits in with their 
responsibilities for teacher training. 

A Word about Basic Research in Education 

Another serious block to instructional improvement is the fact that education 
fails to support adequately the basic research which should precede the design of 
new instructional programs. 

Basic research in education is the study of the circijmstances, processes, and ' 
effects of human learning. The basic- research effort may well be "useless" in the 
sense that it has no immediate application to schools as educational institutions. 
Ultimately, vrhen converted, into instructional procedures, it is extremely useful. 

In a logical sequence of events, basic research should, be labeled, "Phase 1." 

It should, precede and help generate the design effort. However, the writer found 
that most innovation does not flow methodically from basic research, but is und.er- 
t alien quite independently. Thus he bowed, to the facts and. labeled, program design 
"Phase 1." It is his opinion, however, that design efforts should, draw upon basic 




research into human learning and that the best designs will come from the conscious » 
delibe rate, planned translation of that research into programs for teaching. 



The Solution 



Because the problem of change is large, the solution must be equally large. 

It should deal realistically with the conditions which now exist ajid not attempt to 
do the impossible, should draw funds from the most appropriate sources and give 
reoponsibility to those best able to take it, and should use the effective structures 
already in existence but abandon those which are not effective. 

In Organizi ng New York State for Educational Change , the writer has recommended 
a solution he believer is big enough to solve the problem in that state. The heait 
of the plan is the creation of special, separate circumstances for the design, evalua- 
tion, and dissemination of new instructional programs. It seems probable that this 
plan has implications for other states. 
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Much has been said about the gap existing between research and practice, and we 
are reminded of the old Vermont farmer who, when asked to cooperate in some agricultural 
research, commented, '’Shucks, I ar .'t farming half as well as I know how to now’" 

Well, our thesis concerns the neec for more of both research and practice , and suggests 
the pressing urgency of systematic organization and a thorough understanding of the 
processes involved in Research and Developme nt. 

According to Charles F . Kettering, research is a high-hat word that scares a lot 
of people. It needn’t. It is rather simple. Essentially, it is nothing but a state 
friendly, welcoming attitude toward, change, going out to look for change 
instead of waiting for it to come. Research for practical men is an effort to do 
things better and. not to be caught asleep at the switch. The research state of mind 
can apply to anything: personal affairs or any kind of business, big or little. It 

is the problem-solving mind as contrasted with the let-well- enough-alone mind. It is 

the composer mind instead of the fiddler mind. It is the tomorrow mind instead of the 
yesterday mind. 

Rp'search is theoretical analysis, exploration, and experimentation directed 
towo-*. o the increase of knowledge, and. thereby the power to control phenomena. 

Webster defines "research" as "...studious inquiry. . .critical and exhaustive 
investigation or experimentation having for its aim the revision of accepted, con- 
clusions, in the light of newly discovered facts." The word "research" is so widely 
used vrith such varying connotations that great confusion results. Research can be 
definea as Lhe application of human intelligence in a systematic manner to a problem 
of which a solution is not immediately available. 

Webster describes "development" as "a step or stage in growth, advancement; 
hence, an event or happening." 

There is today an increasing awareness and sense of urgency for research and. 
development (improvement if you will) in ed.ucation. In many areas we find, persons 
seeking, striving, straining, clamoring, thirsting, imploring for change to meet the 
needs of today. IKiis applies to all of education, including most certainly that 
which you represent --vocational-technical education, 

Vccational programs were for many years predominantly characterized by a high 
level of excellence— and were generally so recognized. The interest and attendance 
at this conference testifies of your belief that we need now devote special 
attention toward, organising for research and. d.evelopment . Behind this must have 
been -among other things -the feeling that our field of mutual interest needs 
some new vigor, some variations of old. ideas, some brand new ideas, and. widespread 
willingness to adapt to the needs of changing times. 
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I suggest the problem which confronts you is of such priority and importance 
as to merit well -planned organization , systematic i nnovation^ flexibility, and 
adapt ivene^ in your research and development activities. As yet, there is little-- 
or, at most, inadequate-- assurance that our developing programs will possess thece 
essential qualities. 

My assignment today concerns the challenge of organizing for change in voca- 
tional-technical education. Let me begin by focusing your attention on the over- 
all setting and talking about state departments of education. 

State divisions of vocational education are important parts of state depart- 
ments of education, and that which characterizes the latter generally characterizes 
their divisions of vocational education. 

Perhaps more so than ever before, it is today essential that state departm^'-^nts 
of education be strengthened. This is supported by the philosophy of the present 
federal aoministration as reflected by various actions, the Elementary and 
Secondary Education Act of 1965 being the most recent . 



Not long s.go James Bryant Conant said, in referring to policy-making for the 
public schools, "What is needed are strong state boards of education, a first-class 
chief state school officer, a well-organized, state staff, and good support from the 
legislature." Conant has also noted that in some instances, "the state education 
departments, though possessing considerable formal authority, are capable of little 
more than the performance of routine duties." In commenting further about the 
determination of educational policy in the United. States, he says,^ 

"Educational policy in the United States has been determined 
in the past by the more or less haphazard interaction of 
(1) the leaders of public school teachers, administrators, 

^d professors of education, (2) state ed.ucational authorities, 

(3) a multitude of state colleges and universities, - (4) pri- 
vate colleges and universities, and. (5) the variety of 
agencies of the Federal government, through which vast sums 
of money... have flowed, to ind.ivid.ual institutions and the 
states.... It is my thesis that such a Jumble of influential 
private and public bodies does not correspond to the needs 
of the nation..." 



^Conant also points out the need for strengthening state departments when 
he said,‘=^ 



Without appearing to belabor an obvious point I do wish to 
emphasize how reformers intent on using the Fed.eral power 
have repeatedly been forced to use what I have called, federal 
bribery*to accomplish their purposes." 



Conant, James Bryant, Shaping Educational Policy, New York: McGraw-Hill. 

1964, p. 31. 

2lbid., p. 120. 




high©!* ©ducQ.'b.lon. h&v6 long 6XC6ll6d, in nismy pli8,s6s of ©duca- 
tion, but theirs is not the business of se-" Ing policy for public schools, or for 
providing direct leadership to theim. They .lave rightfully had. a monopoly on ijinder- 
graduate and graduate worlc, but they have not and should not assume or be delegated, 
state-wide or local responsibility for public education. This is neither philo- 
sopnically desirable not lega.Lly in order. The colleges and universities, through 
the consult^t activities of professors, have made efforts of seme significance to 
provide assistance to local schools; however, this has not been a major or top- 

priority concern of higher education, and it is grossly inadequate for many 
reasons. 



^ Constitutional and statutory (as well as logical ) responsibility for the 
public schools . rests with the state which has established an agency with state* 
responsibility for this purpose. At the 1964 annual conference of the 
Council of Chief State School Officers, Conant said that as recently as five 
years ago ne would, have ad.vocated that local boards were the keystone to educa- 
tional policy and that state departments of education were just to be "tolerated." 
He went on to say to the chief state school officers, however, "It is now clear 
to me that tne jobs which you hold, are or should be the key positions in educa- 
tion and not the structure of public education. . .in the United States." 



As long ago as 1957 John Guy Fowlkes^ of the University of Wisconsin, in 
re.i.erripg to state departments of education and the chief state school officers, 
said, "These are the agencies imd officials who, more than any other ed.ucational 
organizations and workers, have responsibility for and work with, to varying 
degrees, all le^'^^els, kinds, and forms of public ed.ucation in our country." 

There is an increasing concern nationwide about the strengths, capabili- 
ties, and limitations of state departments of education as they currently 
exist. ^TTiere is general recognition that the weakest link in the ed.ucational 
triad of local schools, higher education and the state department of ed.ucation 
is most often the latter. Frequently, one hears criticism that these depart- 
ments not only fail to promote changes for improvement in ed.ucation, but they 
also obstruct the efforts of others. 

Techmen^ concluded that the present standards of state departments are 

not able to keep pace with postulated new practices, and little leadership was 
fomid. 



The average state department of ed.ucation^ has 75 professional staff 
members available t-o work on educational problems and programs. Such a 



^Tliurston, Lee M. , and Roe, William H. , State School Administration 
New York: Haip)er Bros., 1957, p. vii. 
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State Departments and Reg i onal Accr editing Associations 
in Secondary School Experimentation, The Ohio State University, 1§^2, 
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■^Will, Robert F., State Education, Structure and Organization, p. 33. 
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department works with 425 school districts, including 1,003 elementary schools, 

80 junior high schools, and 220 high schools. These are staffed (1963~64) with 
10,827 elementary teachers, 1,916 junior high teachers, and 5,401 senior high 
teachers. There are in addition 170 superintendents, 42 assistant superintendents, 
633 elementary principals, 74 junior high principals, and 159 senior high princi- 
pals. In summation, the 75 state department of education staff work with 1,303 
schools and about 20,000 local school people- -for the purpose of maintaining 
standards, teacher and administrator training, and the generaJ- improvement of 
education including buildings, methods, and materials for teaching. 

How can any state department of education staff be effective with a ratio 
of 75 SDE persons to 20,000 local school people? Some state d.epartment con- 
sultants^ estimate their aver a/:.; e "visit" to schools to be one half-day each 
seven years, A few are able to approach the level of one visH in each two- 
year period. Obviously, this preclud.es reliance upon the procedure of working 
v/ith individual teachers- -especially when one teltes cognizance of the time 
required for desk work and travel. It would be not only impractical, but also 
unrealistic and undesirable to attempt to increase SDE staff to a number that 
could satisfactorily (under traditional procedure and organization) meet the 
challenges and. effectively influence change for improvement. 

Begiiining with the preced.ents set by Horace Mann in Massachusetts, state 
departments of education have quite adequately performed such tasks as record, 
keeping, disbursement of funds, inspection, compliance checking, and enforce- 
ment of minimum standards. There is today anothei' function which is sorely 
needed by public education. That is one of service and, leadership to point 
the d .ir ection for chang e and i mpro ve ment in ed.ucation , and to assist with its 
imp3.ementation in the public schools. (This does not preclude continued.^ 
performance of services in record keeping and compliance checking, but these 
should constitute a minor function rather than the raison d’etre.) Instead, 
of spending 90 percent of their time on inspection and compliance checking, 
and. 10 percent on promoting specific change for improvement, state depart- 
ments should reverse the ratio and. devote 90 percent to leadership for change. 

(Che Need for Research and. Development in E ducati-^n 

The average citizen today recognizes that "R and D" stand for the two most 
important words in American industry- - Re search and Development , which form- the 
basis for most of the outstanding achievements of our country’s industries. 
Companies which show the greatest progress and. market the largest number of new 
products are those which budget generously for research and development, 
establish responsibilities, and organize accordingly. Many of our outstanding 
growth companies pour back into research and development as much as 10 percent 
of their net incomes. The automotive industry is a prime example. How long 



^Discussions of the writer with personnel in Oregon, Washington, and 
Wisconsin state departments of education in January and February, 1965 > and 
with each of the 50 chief state school officers and staff members d,uring 
1959" 60. 
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I could (or can) any of the leaders in this industry compete without continual 

research and development? A common story among the most active industries is 
that more than half of their new products are less than ten years old* Were 

I it not for strong research and development programs, companies in the fields 

of electronics, drugs, and metal products (to name just a few) would soon be 
out of business. 

I Professional people, such as the doctor, the pharmaceutical worker, and 

the dentist, must carefully follow new research in order to keep abreast. We 
are most critical of our professional people who fail to make use of the findings 
I of research. 

The U. S. Department of Agriculture, the land-grant colleges, the Agri- 
cultural Ejqperiment Stations, the county agricultural staffs (agents) and a 
multitude of farmers coope^at-- in performing the essential tasks of research 
and development in agriculture. These agencies and individuals are responsible 
for research on agricultural problems, whether local, state, national, or inter- 
national, and have a mutual interest in achieving solutions and improvements. 

Some federal monies are utilized, but the major amount of the activity is sup- 
ported by state funds. This widely dispersed research effort within each state 
is coordinated and correlated by a state agency to bring about overall balance, 
avoidance of gaps, end. a balanced attack on agricultural problems in general. 

The technological advances which have resulted in agriculture and industry 
have not come about spontaneously or haphazardly. They originated in deliberately 
planned, carefully organized, and. adequately financed, programs of research and 
development. The methods, organizations, and. procedures utilized in American 
industry and. agriculture are the objects of worldwide admiration and emulation. 

We are now allocating huge sums of public capital to research in education, 
but hox-/ well are we organized? The truth of the matter is that, excellent 
though our basic research has been, far too much of it remains on the shelves 
and in the pigeon holes gathering dust. The necessary follow-through activities 
and implementation have been sadly neglected.. 

Currently, we have at our fingertips sources of financing far greater than? 
ever before. We have not previously organized, for change or systematic innova- 
tion- -but now v/e must or fail in our endeavor. 

The Change Process and Implications 
for Divisions of Vocational Education 

Generally recognized^ today is the need for accelerated- change to keep educa- 
tion programs and practices in tune with demands c.reated by the rapid expansion 
of knowledge, an intensely competitive society, the expanding population, new 
ways of living, and the changes created, by increased, automation. 

Too often there is undesirable competition between agencies or institutions 
in different levels of education, and sometimes apprehension and resentment of 
each other's actions— or lack of action. This is little short of calamitous, in 
view of the magnitude of the over-all task in education and. need for improvement. 
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Comprehension and agreement concerning individual and joint responsibilities are 
essential if we are to effectively influence change for improvement in education. 
Changes in education are inevitable, whether planned or not, and it behooves us 
to actively endeavor to influence the process. 

The research work traditionally done by the colleges and universities hss 
been generally excellent insofar as basic research activities go; however, there 
is great need for applied research for activities such as program invention; 
field testing, dissemination, demonstration, and implementation. The latter 
activities (frequently encompassed by the word "research”) are appropriate 
functions of the State Department of Education and of local schools, as well 
as sometimes higher education. 

The divisions of vocational education should have prime responsibility/- for 
isolating major problem areas and then coordinating the efforts (sometimes 
subcontracting) to attack problem areas in education. Some of the problem areas 
can be attacked best by local schools . Experience has proven that they will not 
be so attacked, however, unless the State Department of Education, with the aiii 
and cooperation of many schools and coJ.leges, identifies and spotlights them, and 
then exerts coordinating leadership to bring about improvement. 

Certain kinds of research and development may properly be done by the divi- 
sion of vocational education. The division should arrange for local school and 
higher education personnel to devote energies toward, achieving solutions tc the 
problem areas which have been isolated and. defined. The division has major 
justification to concern itself with many kinds of research and research-related 
research, but much less with basic research. 

It is neither desirable nor feasible for personnel of most local schools 
to thoroughly acquaint themselves with the technicalities (red tape) and. general 
requirements. Likewise, it is equally or more -undesirable to train or acquire 
local school persoi-inel already skilled, in the intricacies of the necessary 
research design. 

The divisions of vocational education need personnel skilled in research 
d.esign to provide state- level service for public schools (and. to a lesser extent 
to higher education )throughout the state. 

Local schools are the logical setting for many applied, research activities 
and field testing. They constitute t^ focal point for implementation. 

Commissioner Keppel, in his letter dated. April 9 addressed, to state 
departments, has detailed means that states can follow in applying for funds 
to establish a state program of research and. development in vocational ai:id 
technical education. State departments, universities, and. even private organi- 
zations have vital roles to play in this essential function. The details of 
implementation may vary to some degree from state to state, but the need and 
the motivation is similar the country over. 




successful establishment of research and. development pro- 
ceding ro\es?"’“® Process of Chm^e. a^d agreeS ?oL 



The chart 



* 



(and accompanying explanation, see pages 37,38 and 39 ) which 



for^toe pertaining to specifirdivislon Tre?p 4 Sbmties 

for the several areas of research and research- related activities. 

Summary 

areas'^Lr^lenS^n^-^ ’ although we have dealt with the several 

(problem definition, research, program development, field testing, dissemina 

overia^inr^irfrf separately, we recognize that these are 
overlapping and frequently some are entirely omitted from consideration. Because 

iftrLirSttirScies^^^t^^ T activities cannot be separated 

schooir J imperative that the three agencies (local 

tion or acuL^5?^^^n-LM '>“<l®rstanding of the change process. Implementa- 

favorable cliLS fo? ch!!^gL“ specifically plan and create a 

Of hifr™^sp~il 1 tnd^:^r^,^ and each needs adequate comprehension- 

f'^equently prone to believe that their superior 
levels of training, position and experience (sometimes referred to under the term 

sacred -tLX prohibmng 

ti:naliteX“al1dL"tio!!®to^^^^^^ “®®"®" 

last, the people of this country have come to recognize the basicallv 
igid and ^n-comprehensive programs existing in the great majority of our secondary 
ndv,°° P’^°®’^a“s> primarily college -prep in nature, resulted from rigid 

adherence to the concept that the supreme goal of educatioA could only be XLula- 
tion in the conventional h-year institution (college or university)? “atricula- 

+V,- ^2i that we have support and resources to improve education for the vouth of 

this aftern^n and tomorrow, it behooves us to ca^efuUy and th?ro??hly o??^?zf for 
Research and Development, and to avoid some of the obvlLs errors ^ the pS? 



*. 



TiPfln individual discussions and workshop activities involving 

Dean Lindley Stiles, Drs. Philip Lambert and John Guy Fowlkes of the Universitv of 

University; Dr. Jack Culbertson of UCEA; 
p * 4-^ ^ n hammer of the University of Oregon; and others. Refined from 

Cooperative Research Project #F-032 (Principal Investigator, Allen Lee)Vl96k. 
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A RATIONALE FOR THE ESTABLISHMENT OF A VOCATIONAL EDUCATION 

RESEARCH STRUCTURE 
by 

Herschel T. Lester, Jr. 

Director of Research 
Division of Vocational Education 
University of Georgia 



does not keep pace with his companions, 
perhaps it is because he hears a different drummer." 

Henry David Thoreau, 1906 

Many of the functionaries charged with rp<5Pnyf»vi ■py.„«4.-5 pj x- 
education encounter many circumambipnf ^ fructification in vocational 

which retard or facim^t^Srr^npfcc ^ties and seemly urgent priorities 

research progrLs! if is thrn^osfn? conducting educational 

situation in terms of useable research struf urer’^fpf Lf current 

implementing research findings and c/ ^ outline procedures for 

structures. endings, ana (3) to suggest plans for future research 



CURRENT RESEARCH STRUCTURES 

corducreduLtionarrese^ persons who administer or 

when research is to becomfL intplpfr"*® t t entering an era 

This statement is already true regardino- total educatioial program, 

would appear that vocational Pdnpf-f-* ^ ^ me phases of education; however, it 

In the list, most lompletef res^ch^L 

to have provided a sublimenal stimulus to -hbP f ^°^^tional education appears 
the fact that too many studiL wprp ^ ^ Program. This may be due to 

little interlocking departmental coLLpL^ Planned. This procedure encouraged. 
The end results of thi«? aT^ny.fh£i«v,’v, university, or state coordination. 

h^hazard research methods^were employed '*°ln facf*^^” perfunctory and 

lacking lfVaL1trLLg\\\ :”Lue1i: f 

responsible for some nf f ^ conditions or factors may be 

the part of educators, (2) lack of "hard^^ es, such as; (l) lack of interest on 

Of administrative ^derf"i,di“g LrroSiof (4 d™ 
state department policies and reguLafi nne ^c:\ i i ^Igid university and 
not even attempt to understand the foT-Pmi- ^^x x federal programs which do 
of the first magnitude that is eas-iiv ^ ng statements. Perhaps the problem 
is evident in ^arlfall ^ recognized by vocational educators and 

individ::L^ehr::nLifofiff:ai°rf“^^^^ 

all other duties are comoleted short, research is postponed until 

lack of support approach, many of today • ff^ucS ‘ arf lef 

for research findings. uut.aouz-s are learning little respect 
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Graduate Research 

T - 4 .U well known patterns or approaches to research may be identified 

!fnd?«!^ ^fu^u advantage of ’’captive or slave labor” to conduct vast research 

attenrot to^Lef qualified personnel, in fact, most graduate studies 
attempt to meet minimum specific requirements of a graduate school, while others 

meet only tnose requirements of a professor. These studies, in some cases have 
been undertaken using poor research procedures and methods to ”prov^ certaif 

p cedures, and. to attack foregone conclusions. In the past, these tvnes of 
to personnel, and time. How much we learn and Se able 

aaaear tw questioned .nd opened to discussion. K „ouW 

appear that this scheme of conducting research has encouraged little hvbrLiza 
tion or cooperation between departments, while in fact, in some cases'^coordina- 
lon between professors within their own departments has been very limited This 

administrators from using the resuUs irL iTeasily 

aid en^ourl^e'd Sts undustified colllionf 

encouiaged students to dislike research. These and manv other -niffniic or^n 
cerning graduate research could, be overcome by providing adequate full time 

Inlrlshil’^S^Ln 11" could^Sakl'i Inarch 

internship at full salary for an extended period. 

Paradigm Structures 

problim^l TtheLl orfi™ert1?i^n1o1f sifrstudy olTImailJer^"® 

tollsearl iLsIn StemptH^^M .°f*®" '^®®" apPlied by vocational educators 
!fr!i f areas in attempts to obtain data that could be used to design develon 

many pastlLdils cILctddll^kiliiLIcItrltf ’ Z°‘' “If 

H^::a11Sl1hTa“^ lalcoulHoll l^sltlrltr 

nn o+4-^ r^Z Should, be a procedure or method which people raav use as 

should he °.®"*®^.*^®.'^°°™by of knowledge in vocational education. The approach 

eler vis11dirthefl4°" 1^°"" 1®"® "" ®^®®® "bich fe^ar 

loialldllllT^ """ """ unexplored, and chartinlor^ desUnyi:; voca- 

tionai ed.ucation, and in many cases, a study of our "holy golu.en bovines " Th-i« 

approach to research is useable throughout all aspects of Education, bl'it shlld 

be considered imperative for vocational education; as traininriog^amrolhll 

?og11ar ® rapidfylTa^gl^gleci^l 

requirlmnvm°1®“°"ts will not just happen, on the contrary, it will 
sUier ®<^bte departments of education, univer- 

j ar . federal agencies as attempts are made to develco this chase of 
vocational education. Several problems must be overcome before loL- range 

?oi::a •’® -d®rtaken. Some of the11:^ bllutll^ed as 









1. Adequate time must be mad.e available. 

I 

2. Adequate permanent funds must be made available. 

3. Administrators and teachers must be convinced of the value of 
planned research. 

U. Personnel must be adequately trained in techniques. 

5. Personnel and students must be mlling to conduct programmatic 
research. 

To meet situations now developing in vocational education, we must structure 
research that will provide comprehensive and flexible guidelines to broach and 
inaugurate programs which will prepare individuals to enter upon, mal ^ progress 
in, and become adjusted to the world of work. If we are not to be passed by in 
the race of progress, we cannot rely on trial and error, catch as catch can, but 
we must make planned educational changes discovered by adequate research programs. 
The paradigm under discussion should focus with explicit sharpness on the behavioral 
characteristics of teachers andstudents. These teachers and students should be studied 
in terms of how to develop new educational concepts and perceptions, upgrade course 
content, determine the necessary prerequisite knowledges and attitudes needed to be 
successful in vocational programs, and develop new instructional methods and 
procedures. 

Federal and State Morphic 

If planned research programs are to be designed, and. structured to broach the 
•nast void of research findings, certain existing conditions m.ust be modified. Those 
who administer federal educational research programs must change present funding 
procedures for it appears that projects which are submitted, and. designed by persons 
who have insufficient experiences, but who have academic backgrounds in certain dis- 
ciplines, received priorities. It should be made crystal clear to all these persons 
that federal research monies are appropriated, under legislative authorizations; 
therefore, the monies have been allotted for specific purposes. In short, voca- 
tional education research monies must be made available to focus upon research 
problems which are directly related, to the stated, objectives of the 1963 Act. It 
must be remembered, that all public monies must be accounted, for in terms of the 
specific purposes for which the monies were appropriated, and not in terms of what 
a group of federal administrators, panel members, or others may deem. 

Within the last few months, much time and money has been spent by federal 
officials to conciliate and. emphasize the need, for mutual cooperative efforts 
between vocational ed.ucators and persons who represent related disciplines which 
appear to logically support vocational education, i.e., anthropology, economics, 
education, political science, psychology, and. sociology. These efforts have been 
in terms of a conjunctor of vocational educators and. persons of other disciplines 
to broach research problems on a mutual basis. Over a period, of years, this trend, 
may be beneficial to vocational education. This philosophy is very benevolent to 
the "scholarly disciplines" to say the least. Much can be said for the hybridiza- 
tion of these disciplines with vocational education, but much thought and study 
should be given to the plan before unmitigated abandonment is attempted by our 
self-appointed leaders. 
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With today s trends within these so-called "scholarly" disciplines beinfr 
conditioned on the assi^ption that dichotomies (i.e., night-day. black-white^ 
and fabrications-truth) are representatives of reality, it v/ould appear that’ 
extreme caution should be exercised by persons doing research oonc«n^ uLing 

These^di^ci^v”^^ education learning experiences do not appear to be d^hotomies. 

overly stress the use of empirical data deemed so necessary by 
• £ scientific study. The postulation that anything not directly observable 

theory. In fact, it may not even be tenable as an assumption. It 
does not appear to perturb these Pharisaical persons that much of the data of 
vocational education is not directly observable and is not known oSy though 

educat^"™ ef-ects. For in study after study, these so-called non-voLtional 
educators continue to exhibit statistics which are overly refined to determine 

of^Wr"^ ^ instead 

f i|^uen. These types of over-designed studies attempt to formulate universallv 

pplicable generalizations; however, this approach is likely to provide an 

inadequate orientation to the research worker in a field just beginning to 
systematize its knowledge. ^ ^ming t^o 

the assuiuption— "Problems of learning and of motivation are basic 
problems to vocational education." This same statement is also a maj^ pre 
occupation of psychologists and general educators. This same t>pe of crLsroads 
situation has been faced, in the medical profession in terms of: "How much of the 
needed research should be done by the medical research physician and hrlch 
should be done by non -medical researchers?" Large numbers of sociologists, 

psychologists, and other non-medical research 
specialists, are being employed within the field of health research. However 
n nearly all undertakings, medical research specialists direct the overall 

Whv^""! objectives. Several assumptions may be ad.v^cerL to 

why tne medical profession employs this approach, such as, (l) fear that the 

" ^^sent,’(2) lack’of megc^^e^erLnce 

n is basically needed to define and carry out the research that must be done 

to meet progr^ objectives, ( 3 ) perhaps, in order to obtain federal funds these 

persons must be employed or the projects will not be approved, and ( 4 ) lack of 
trained, medical research personnel. PP^^vea, ana. lack of 

It would seem from the prevailing philosophical approach to research that 

SoLbL especially in the areas of vocational education. 

Somehow, ii, seems that too many federal personnel feel that research sociologists 
psycnologists, etc., qualifications Ph.D.-oan by magic means, sidestep all thf 
ritical questions relating to criteria, problems of data collections and existinc 

tal®s^tings^®°T£^^^- teachers and other school environment^ 

This is the most gross injustice and falsification of thinking that 

diff ic'a^t^i^formu^a^ most capable senior research persons have had gr^t 

difficulty in lomulating quality studies in areas of learning and motivation. 

PROCEDURE?. FOR IMPLEMENTIKG FINDINGS 

It has been recognized by a.lmost all vocational and other educators and 
administrators on l.ual, state, and. national levels that need for dissemination 
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of research findings should have first priority. However, this has not been the 
case. Most efforts at disserni nation of research findings have been uncoordinated; 
for example, dissemination of proven innovations, such as, materials regarding 
prograncaed learning, newer methods of audio-visual aids, and computer technological 
studies have not even been attempted. 

Several other innovations and research findings which have not been dissemi- 
nated could be listed. It is mandatory that careful attention be given to the 

flov/ of information to classroom teachers if research findings are to have immediate 

and desireu effects on education practices. The usual means of communicating 
research findings, (i.e., journal publication and presenting papers at professional 
meetings) are too slow and ineffective for most teachers. Other media besides 
print, should be used, such as: (l) educational television, ( 2 ) computer instruc- 
tion, using the IBM or similar systems, in a series of schools, ( 3 ) radio, (1+) demon- 
stration programs in varying tiTpes of schools on a large scale, and ( 5 ) the use and 

involvement of faculty members from public schools and colleges in the planning and 
carrying out of specific research studies. In fact, most research has been primarily 
oriented tovmrd the controlled conditions of the laboratory and not toward classroom 
educational environments. Some thought end effort should be given to the future needs 
for research aimed at application of findings related, to methods and basic research, 
including use of important learning variables. These imderteikings should be in terms 
of basic concepts and principles as related to the practical problems of the uncon- 
trolled environmental classroom situation. This approach could also provide a much- 
needed bridge between learning process personnel interested in laboratory controlled 
research on the one hand, and those interested in actual classroom situations on the 
other. This applied research and developmental approach may have several outcomes, 
i.e., a useable teaching method or device, film or an educational program of superior 
quality. 

The foregoing is not meant to downgrade basic or exploratory research or hypoth- 
eses testing, but to evaluate in ed,ucational environments these new-found, methods and. 
techniques. Other methods which should, be looked, upon in a favorable light are 
explorator;y work in non-data producing activities as needed in critical reviews of 
literature, generation of theory and other similar activities. Demonstrations of 
new innovations should be provided for purposes of affording teachers, administrators, 
and the public an. opportunity to see the new method, or system. Of course, the well 
knovm pitfalls of "demonstration researching" must be overcome, i.e., an innovation 
versus some unidentified conventional method, lack of basic control data, short-term 
demonstration programs, and the use of one or two teachers to "prove" the innovation. 
If demonstrations are to be undertaken, sound research methods should be used based 
upon reflective thought and a thorough review of the literature. 

PLANS FOR THE FUTURE 

The foregoing sections outline many questions which are most difficult to 
ansvrer. An attempt must be made to structure a planned research program that will 
provide valid data in which vocational-technical, education programs may be founded. 
Briefly, the following procedure may be used, as a beginning place: 

1. Establish a proced.ure whereby one person within the state may 
coordinate all research undertaken in vocational education. 
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Duties of the individual woald be as follows: 

a. Consult with research personnel or interested people in 
planning, designing, structuring and under talking of 
research projects. 

b. Collect and disseminate information on research procedure. 

c. Collect and disseminate research publications. 

d Secure necessary administrative approval for undertaking 
projects. 

e. Secure funds for carrying out studies. 

f. Accept completed projects. 

2. Estat^lish a State Research Committee to review all proposals and to 
establish fimding priorities for submitted proposals. The Committee 
should point out significant research problems and assign priorities 
' and responsibilities for making the studies. 

This Committee should have as members the following individuals: 

a. One teacher educator from each vocational service . 

b. One supervisor from each vocational service. 

c. State director for vocational education. 

d. Dean of the college, 
f. Director of research. 

Other duties of the State Committee may include: 

a. Plan a comprehensive, long-range State research program. 

b. Provide means for acquainting teachers, administrators, 
and others with pertinent research findings. 

i 

c. Involve research specialists and consultants in other fields. 

d. Establish needs for additional qualified research personnel. 

It should be pointed out that this procedure is based upon the premise that 
a permanent research budget will be established. Withput this budget, qualified 
personnel to draft proposals and direct studies will be hard to procure. In 
addition, without a permanent budget, quedified graduate students cannot be 
recruited who are capable of conducting quality studies for an extended period 
of time. <: 
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3 * Establish individual research committees by services similar 
to the AVA research committees. These committees are to be 
made up of teachers and other selected, people and will assist 
in pointing out the problem areas. 

SUMMARY 

The purpose of this paper has been to (l) explore the current situation in 
terms of useable research structures, (2) to outline procedures for implementing 
research findings, and (3) to suggest plans for the future. 

In the past, most completed research as related to vocational education 
appears to have p:^ovided a sublimenal stimulus to the total program. This has 
been caused by many factors; however, the factor which stands out, and is easily 
recognizable by vocational educators, is- - Time . 

Graduate studies have been used in the past to conduct vast research studies 
with hal.f vast qualified personnel. In fact, most graduate studies have been 
almost useless as a tool in piginning vocational prograrfls. It should be pointed 
out that structured research efforts will not just happen, on the contrary, it 
will require untiring leadership efforts of state departments of education, 
universities, and federal agencies to develop this phase of vocational education. 

If planned research programs are to be designed and structured to broach 
the past void of research findings, certain existing conditions must be modified. 
In short, vocational education research monies must be made available to focus 
upon research problems which are directly related to the stated, objectives of the 
19^3 Act. Much can be said for the hybridizati^on of these disciplines with 
vocational education, but much thought and study should, be given to the plan 
before unmitigated abandonment is attempted by our self-appointed lead,ers. 

Implementing research findings has been recognized by almost all vocational 
and other educators and administrators on local, state, and. national levels. It 
is mandatory that C8u*eful attention be given to the flow of information to class- 
room teachers if research findings are to have immediate and desired effects on 
education practices. 

Plans for the future must be organized around a structure of planned 
research efforts. These efforts should, include: (l) coordination of research 

efforts, (2) establishment of some type of state review panel must be established, 
and (3) structuj;© individual research committee by services. 
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0(3CUPATI0NAL EDUCATION IN RESEABCH 
The New York State Education Department’s Structure 

by 

Alan Robertson 

Associate in Vocational Education Research 
New York State Department of Education 



New York State has pioneered the appointment of personnel to its staff to work 
full time on research in across-the-board vocational education. As early as the 
Fall of 1962, plans were made and a position approved in the budget of the Voca- 
tional Ed’-cation Instructional Services Office to add such a position to the Office 
of Research and Evaluation- 

In € recent survey of State and U. S. Dependency Education Departments 
(January, I965) conducted for the Research Committee of the American Vocational 
Association, it was determined that this arrangement was unique in the fifty states. 
Vniile it was true that sevcjral State Boards for Vocational Education had assigned, 
research duties either full or part time to Vocational Education staff members, or 
observed the practice of channeling assignments to a specific member of the State 
research staff (who could be noused at a State University), the New York State 
Department of Education’s provision for vocational education research was 
unduplicated. . 

In essence, it provides for a full time research professional with the same 
basic research qualifications as other professionals of the same grade, broadly 
knowledgable in vocational education although not a subject matter specialist, and 
appointed from a Civil Service list as a research associate in the Office of Research 
and. Evaluation. Salary and. travel expenses are carried, on the Vocational Education 
state staff budget, and until the beginning of fiscal '66 were paid, for through 
Title I, George-Barden Act. Supervision of vocational education research staff, is, 
however, under the Associate Commissioner for Research and Evaluation through the 
Chief of the Bureau of School and Cultural Research and. the Director of the Division 
of Education Research. 

Major work assignments and duties generally originate with the Assistant 
Commissioner for Vocational Instructional Services, i.e., the State Director for 
Vocational Education, and are channeled, either directly by him or via the Associate 
Commissioner for Research and. Evaluation to the Associate in Vocational Education 
Research. Excellent professional relationships and mutual regard between the Chief 
Administrators of the two offices have made a major contribution to the smoothness 
of operation of this dual arrangement. 

The advantages of this structure lie in that, for an expenditure for one 
professional staff salary and. expenses. Vocational Education thus has the full 
resources and. potential of all of the other Research and Evaluation staff behind its 
own man on the teai.a. As illustrated, by the accompanying diagram showing the personnel 
structure of the Research and Evaluation Office, a variety of specialized, research 
talent is thus available for formal project assistance or informal consultation on 
vocational education research problems. On the research staff, are specialists in 
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research in the social sciences and social structure, on elementary, secondary, and 
higher education, in experimental design and program evaluation, in educational 
psychology and in the application of statistical techniques to research problems. 

Data requiring computer analysis is channeled through the Bureau of Statistical 
Services which provides for data coding and "run sequences" and then routes this to 
the Division of Data Processing which houses and operates its own equipment. The 
complexity of modern vocational education problems which deal with the labor market 
economy and changes, with all elements of human behavior, with social structures as 
well as problems of learning, vocational subject content and educational facilities 
structure for all persons of all ages, makes a quality one-man operation in voca- 
tional education a difficult task. 

Within the framework just described, activities of the Vocational Education 
Research Associate have been those of short-term project data gathering and analysis, 
of consultation in research project design, execution and dissemination with the 
operating bureaus such as Home Economics, Agriculture, Trade and Technical education, 
with coordinating of contract research projects for these Bureaus with agencies out- 
side the Education Department, and more recently, as a coordinator and resource 
person to those public and. private educational axjencies developing project proposals 
for funding under Sections 4(a) and 4(c) of the Federal Vocational Education Act of 

1963. 



Under the present limited, vocational education research program a compilation 
of total functions and activities would include the headings below. The Associate 
in Vocational Education Research under general supervision conducts research and 
does evaluation in the area of occupational education. 

1. Assumes complete responsibility for conducting of research projects 
for a broad range of types of studies, including the identification 
of training needs of youth and. adults, measuring the effectiveness 
of occupational infomation materials and programs, evaluating pro- 
grEuas and methods of preparing youth and adults for entry or up- 
grading in occupations, conducting population and program studies 
in determining education needs, program characteristics, financing, 
and administration of area vocational schools, and for studies and 
evaluations of professional services, including administration, 
supervision, teacher education, instruction, etc., in occupational 
education. 

Submits advisory opinions after careful study if research projects 
shall be conducted within the Bureau of School and Cultural Research, 
the Education Department, or contracted out to local school systems, 
colleges, and. universities, or private research institutions. 

With regard to projects conducted within '''he Bureau, he prepares 
outlines of the research, discusses outlines with appropriate con- 
sultative personnel, prepares instruments to be used (e.g., data 
gathering and tests), plans procedures for data tabulation and. 
analysis of results, supervises necessary clerical work, and writes 
reports. 
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Vocational Cliief, Assis'cant Conmiissioner 

Education Bureau of Vocational Instructional 

Research Unit Statistical Services Services (Research Projects and 



OFFICE OF RESEARCH AND EVALUATION 
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2. He provides consultative field services to local educational 
agencies in the development of Local occupational education 
research programs, and projects to be federally funded. He 
assists them in assembling and analyzing data and in the 
interpretation of their findings. 

Assists local school systems in identifying and conducting 
special demonstration, experimental, and pilot programs 
designed to meet the special needs of the groups of persons 

mentioned in Federal supportive legislation for occupational 
education. 

3. Prepares materials for the dissemination of the results of 
research and experimental programs through summaries of 
research findings by reporting to professional meetings, 
communication with other members of the Ed:ucation Depart- 
ment, and through articles in professional journals. 



Representation on the Interdepartmental Manpower Research Committee makes the 

InTtil'life ' " ^ Commerce, Agriculture, Youth? Welfare 

and, tne like, available to the Education Department. 

4 -n^n success of this operation and operating arrangement in Vocational Educa- 
vocat?on!rp^ pointed up the unmet need in research, in proportion to the mammoth 

Af vipIHph present and projected operating program in New York as much as 

It yielded research results. Accordingly, a second, research position on the 
associate level has been authorized but is as yet unfilled. Please note the 
recruiting a^ouncement on the last page. If anyone is interested personally or 

have any doctoral candidates getting through either this June or this summer, please 
contact me before Thursday afternoon. , pi.ase 

However, we feel that this structure is spread too thin to do the job which 

sGveLt°o?h State. Accordingly, we have submitted, a proposal, as 

several other states have, for funding of an expanded research unit to betoown as 

the Bureau of Research and Evaluation in Occupational Education which would continue 
to operate under tne Associate Commissioner for Research and Evaluation in the 
relationship previously described. 



Pi-emature to discuss any big plans for this since the proposal 
s waiting USOE panel review, I thought I might mention. some ideas as to the 

operation, so that it might assist some states in crys- 
tallizing their thinking. ^ 



One of ^he ad,yantages of a Bureau operation would, give us more opportunity to 
encourage the submission of small research, experimental, or pilot programs from 
senool systems and provide for funding under section 4(a) Ancillary Services with 
muen less red-tape. We feel that one of our top priority needs in the state is to 

g t more vocational education teachers and administrators interested in conducting 
and utilizing research. 
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In addi'5;ion, a Bureau would concentrate in the following activities in 
addition to doing more of those things we mentioned previously: 

1 . Evaluation in Occupational Education, would be to identify and 
corrdinate research opportunities and projects by all educa- 
tional agencies, public iind private concerned with occupational 
education in New York State. It would do this by: 

a. Scheduling periodic state-wide conferences'; similar to 
those already held, to identify high priority research 
problems and suggest institutional and procedural 
arrangements in carrying them put; 

b. Establishing a "data bank" on occupational education 
statistics and previous research studies which would be 
available to all public and private educational af'encies 
contemplating research or evaluation projects; 

c. Establishii^ a system of mutual reporting of on-going or 
planned research, pilot training and other type projects 
in the State; 

2 . Scheduling periodic meetings with other large states planning 
occupational education research units, to exchange infomation 
and. give assistance in program development. 

3 . Identification of the components contributinf^ to quality in 
area of Secondary and Community College Occupational Education 
Programs and the development of program quality measurement 
scales and practices for use by local educators. 

4 . Tlie promotion of the application of research techniques and, 
utilization results of previously conducted studies in occupa- 

. tional education by local educators in problem areas. This 
would be conducted by means of lectures, seminars, conferences, 
and. workshops in cooperation with such institutes as Cornell 
University. 

5 . Identification of new methods, materials, and organizations for 
instruction in occupational education, throiagh analysis and. 
study of the most successful Manpower Development and Training 
Programs, and other non- traditional programs, and dissemination 
of this information to other educators in New York and other 
states, 

6. The establishment of regular instruments of reporting to those 
concerned with the guidance and counseling of occupationally- 
bound. youth and adults, the results of such researches end 
evaluations which might have bearing on the labor market, the 
necessary skills and attitudes needed by the student, and the 
educational opportunities needed to bring the two together. 
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This would be in cooperation with the Vocational Unit in the 
Bureau of Guidance, 



7. 



T^e identification and demonstration through cooperating agencies, 

of new approaches to trade, technical and other vocational teacher 
training and certification. 



a. Providing readily available consultant services in project 
piaiming design, and evaluation to all educational and 
I related agencies. 



b, ‘ Setting up a one man" coordinating contact for all areas 

of occupational education research with each major higher 

education institution or research -oriented school system 
in the state. ojo.ciu 



Personnel 



be stSLf occupational Education would 



* Chief of the Bureau (l) 
Associates in Research (2) 

* Assistant in Research (l) 

* Research Aide or Trainee (l) 
Stenographer (l) 

* Typists (2) 



During the second yeair of Bureau Operation, 
staff be added to the above as follows; 



it is planned that additional 



* Associate in Research (l) 

* Research Aide or Trainee (l) 

* Senior Stenographer (l) 



The type of professional staff we would, look for and the New York State Civil 

stSc! ® theL ^ 



t^ ualifications by Grad.e and title: 

classlficaSonf “ accordance with Hew York State Civil Service 

1. Chief of the Bureau G-28 

Salary - $13,170 to $15,625 in five annual increments 

Qualifications - One year of full time in Education Research or 
one year of permanent service as an Associate in Education 

the New York State Education Department. Experience 
in vocational education or its supportive services preferred. 
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Associates in Education Research (3) G-24 

Salary - $11,482 to $12,745 in three annual incrpments 

Qualifications ~ Completion of the requirements for an earned 
doctoral degree including 12 graduate or undergraduate semester 
hours in education other than practice teaching and 12 hours in 
research methods and four years of experience in education or' 
in research or in an equivalent combination. • Ability to plan ‘ 
and conduct research must be demonstrated, as evidenced, by the 
authorship of a doctoral thesis or equivalent research reports. 

3, Assistants in Education Research G-20 

Salary - $8,600 to $10,385 in five annual increments 

Qualifications - One year of. permanent service as Education 
Mde; or Master’s degree and specialization in education 
including eight graduate or undergrad.uate semester hours in 
research methods such as education research, statistics, 
tests and measurements, historical research or sociological 
research and two years of experience in education or research 
and one year of education or of graduate stud.y in education 
or research. 

4, Ed.ucation Aides G-l4 
Salary - $6,l8o to $7j535 

..Qualifications - One year of pem\anent service as Education 
Trainee or a Master’s degree with 12 hours in education 
exclusive of practice teaching, 

5, Education Trainee G-13 
Salary - $5,835 to $7,130 

Qualifications - Appointments are made from the Professional 
Career Test by certification of candidates having a bachelor’s 
degree with 12 credit hours in education excluding practice 
teaching. No work experience is required. After a one-year 
training program, successful incumbents are advanced directly 
to the Education Aide level without further examination. 
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PROPOSAL PROCESSING SYSTEI-1 

INFORMATION FOR NEW YORK STATE INSTITUTIONS PLANNING PROGRAMS* 



’i 



c 

% 




§ 

CO 



£2 



o 

ERIC 



* A Working Knowledge of Monopoly , Parker Bros, would be helpful. 



ADMINISTRATIVE CONCERNS IN ASSESSING DBVELOIMENT 
AND DEMONSTRATION PROJECTS 
by 

David, L. Clark 
Associe.te Dean 
College of Education 
The Ohio State University 



"Developraent of Proposals" 

I. Statement of the Problem 



A* Establishing the existence of a situation (e.g«, an anomaly, a series of 
contradictory "facts," unverified findings, or an \uicharted area) idiich 
defines the problem. 

Relating the problem to its general, scientific, and social antecedents. 

Justifying the utility, significance, or interest inherent in the 
investigation of the problem. 

II. Objectives 

A. Stating the definite goals or ends which will be sought as a result of 
conducting the research. 

Justifying the selection of the specific objectives to be sought by 
identifying the criteria employed in making the choice. 

Ill . Logical Structure or Theoretical Framework 

A. Expounding the structure, or framework within which the situation will be 
investigated. 

Validating the application of the particular logical structure., or theoretical 
framework proposed. 

IV. Hypotheses or Questions 



A* Proposing the specific q_uestions which will be answered or the hypotheses 
which will be tested in the study. 

B. Validating and Justifying the questions or hypotheses chosen for study. 

V. Related Research 

A. Describing the studies, programs, and writings which undergird the 
substantive and methodological aspects of the investigation. 
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weaineMes^ identified materials in terras of their strengths and 



C. Relating the identified raaterials to the current project. 



VI . Procedural Plan 



VIII. 



the overall structure within which the research will be con- 

dlACoBu. includUlff "hVlA cx r* T.rVi-1 /^Vi ^ .. __ 



B. 



X.'Tj. j ,, ic&ettxun wii.x ue con- 

whi-oh Vn the variables which will be considered, the conditions 

+-V 1 A c controlled, the processes by which the data will be gathered, 

the sample, and the sources of data. &«.oxiex-ea, 

analytic procediires and the sample sufficiently 
to indicate that (a) the hypotheses are tested or the questLns are ^ 

^swered unambiguously-the condition of internal validity; and (b) the 
generalizable to the population or circumstance required by 
validity^ questions being considered-the condUion of external 

2P®£|^^alizj^ the variables or conditions in the investigation by 
specifying the instrumentation or the techniques of instrument develop- 
ment including the rationale supporting their selection or development. 

VTI. Work Schedule and Resou rces 

A* d es cri b i n g the time schedule of the project, the human and technical 

resources required, the physix al arrangements which have been or will be 
ma .e o carry on the work, and the fiscal requirements of the study, 

the adequacy of the described personnel and facilities to 

budget requests, and the rationale underlying 
any special conditions or arrangements which are necessary. 



General Ch aracteristics of the Proposal (Gamesmanship) 

A. Internal logic and consistency. 

B. Balance between necessary detail and reasonable length. 

C. Adequacy of communication, e.g., legibility, . readability, clarity, etc. 

D. Force of presentation. 

E. Appropriateness to designated grantor. 

F. Evaluation procedure followed by grantor. 





PROCEDURES AM) TECMUQUES FOR THE ABMDTISTRATION OF RESEARCH 

by 

Orville G, Bentley 
Dean, College of Agriculture 
South Dakota State University 
and 

Director, South Dakota Agricultural Experiment Station 



f-inn ^ few hard and fast rules to suggest as guidelines for the administra- 

tion of research; however, these observations may be helpful to you as you look 
forward to developing your research program in the field of vocational Lucation. 

suggest that a*^successful research program depends less on its 
rganiza^ion^ structure tnan on the technical competence and dedication of a 
research staff, nonetheless the organization and the pliilosophy of the administra- 
tion toward research is of utmost importance to the morale and the effectiveness of 
an othei^ise qualified staff. People do research. It is best done b7peoZ whose 
represents a r^e blend of technical competence and dedication -to 

. arly pursuits well spiced with patience, optimism, and confidence. Similar Iv 

IT. ItTTT to have these same characteristics. In addition 

structured around a latticework that includes such items as 
outlines, begets, and other factors necessary to establish and maintain a 
ohesive prograin. The research adininistrator must have the vision and ability to 
encour^e his staff to develop both a long-time and short-time approaches to 

f stratagem for building an overall program. A sound program 
must provide an opportunity for the research worker to follow ideas to fruition. 
Research is not usually accomplished by an inquisitive mind flitting from idea to 
Idea; on the other hand, a too rigid structural framework for developing a research 

^ “ frequently the case, the real answer as tc the bes^ 
structuie for the research organization lies somewhere between the two. 

Ihe administrative framework of a research organization can be flexible thus 
periiatting an arr^gement that best fits the research mission and the resources 
available for achieving its goals. To accomplish the research objective a prosaic 

understanding of research goals and working arrange - 
ments, both witnin the ^it and the units' relationships to the overall organiza- 

administrator has these relationships established, he 
can bring together a staff and proceed with program development. 

It might be helpful at this point to comment on experiences gained through 
statioL!' ^®s®arch programs and their administration in agricultural expe^ment 

The research program of an agricultural e:q)eriment station is a part of the 
total research effort of the university. The experiment stations are supported 
b^ state appropriated monies and federal grant funds authorized under thrHatch 
o supplemented by monies from other granting agencies such 

as Health, Education and Welfare- -especially the National Institutes of Health; 
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the National Science Foundation; Office of Navsil Research; Department of Defense; 
and agencies of the U. S. Department of Interior. In addition, most experiment 
stations receive substantial amounts in private grants and contracts in support 
of various projects in the biological and natural sciences, and in studies that 
might be classified as being in the social sciences. 

The research mission of the experiment stations is broad in scope and r'learly 
encompasses research in social, economic, and educational problems of young people -- 
particularly rural youth. In the development of the research programs of the 
experiment station, the interdisciplinary approach is the modus operandi ; For ■ 
example, if an experiment station were developing a research program In the field 
of vocational education, I would anticipate that the director would, hope to mobilize 
a team of scientists including part or all of these disciplines: sociology, educa- 

tion, economics, psychology, home economics, political science, vocational agricul- 
ture, resource development, technicians and statisticians. In most experiment 
stations, scientists from many of these disciplines are now involved in research 
programs . 

Another important facet of an experiment station program is "to know your 
territory," as the phrase goes in a popular musical comedy. Since experiment 
stations are concerned with agriculture and rural life, the staff knows and attempts 
to understand rural problems- -farming, ranching, and social and economic problems 
associated therewith. The traditional contacts and established lines of communica- 
tion with rural people, their organizations in the agribusiness complex serving 
rural America have been utilized as valuable tools to aid. the research worker anu 
agricultural experiment station to obtain research data on numerous educational 
problems. Conversely, these same channels are used to disseminate knowledge gained 
through research. 

The experiment stations have been fortunate throughout most of their, existence 
to have had an educational counterpart in the state university and land-grant 
college —the cooperative extension services. Not only has the cooperative extension 
service been the avenue for the dissemination of information, but it provides a 
mechanism for a "feed, back" device from both the rural and urban sectors of our 
economy and population. 

One can speak in generalities about methods of carrying out research and 
methods for its administration. It might be helpful to this group as it looks 
forward to developing a research program in vocational education to go through 
some of the steps considered in d.eveloping a "typical" research project in an 
agricultural experiment st^ion. 

1. The first and. perhaps as important an aspect as any in the 

development of a research program is arriving at a phil ^ophical 
base of understanding toward research. Many people regard, 
research as an accumulation of facts and figures to meet some 
operational need whereas research should be designed to accumu- 
late new knowledge about a given problem or within a given 
scientific discipline. The research worker who has a genuine 
desire to initiate a research program should be encouraged to 
discuss it with his scientific colleagues and departmental 







chairman. Ultimately, it is essential that the experiment 
station director know^bout the research interest of the 
individual, either directly or through adml,nistrative 

channels. Freci'uently the most direct route will be through 
the department head. ^ 

Most directors aren't concerned whether the staff member or 
the department is within the Department of Agriculture j a 
director should be more concerned about the. quality of ideas 
and the research competence of persons wanting to do research, 
than ^n the organizational structure. Organization is 

important, but it should not preclude the initiation of good 
research. 

2. The next step is the identification of .the' problem. To do 
this requires consideration of some or all of these factors: 

a. Competent staff with time allocated for research. 

b. Departmental and inter- departmental research committees. 

c. State-wide and national lev/^el advi ,ory committees. 

d. A clear-cut understanding of the critical questions 
facing people ^d the vision and imagination to apply 
research techniques to assemble meaningful data or to 
evaluate hypotheses and alternative procedures or 
programs , 

3. Research planning requires communication of ideas and the 
delineation of resources needed to accomplish the research. 

The conventional administrative instrument to accomplish this 
requirement is the research project outline. These elements 
should be in a good project proposal; 



Stress the statement of objectives and the elaboration of procedures. 
A good research outline is one that spells out; 

a. A program of research and its broad, long-time objectives. 

b, A specific outline for accomplishing a segment of this 
research (usually called the "Research Project"), The 
project may be designed to cover from two to five years. 



Title 

Objectives 

Reasons for undertaking research 
Procedure 



Budget 

Personnel and. location 

Duration 

Approval 
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4. The evaltiatioii of research results usually involves these elements: 

Bo Orderly accomplishment of objectives. 

b. A .clearer understanding of the problem or phenomenon 
under study. 

c. Difficulty in knowing the potential value of research 
and when it will "pay off." 

d. Publications. 

e. Contribution to knowledge. (Surveys give transitory 
information frequently, but research on more basic con- 
cepts provides a basis for generalizations beyond the 
scope of the population sample studies, or a physical 
or natural phenomena investigated). 

5» Problems tha"c creep into the administration of research programs. 

a. Failure of departments and individuals to develop a long- 
term research plan and goals. Planning should be looked 
upon as a "think device" to answer the question, "How will 
I use my brains, technical help, research funds to solve 
problems and expand knowledge within my scientific or 
professional discipline?" A corollary question should 

be, "How can 1 best organize and direct my talents and 
resources to obtain meaningful results of potential 
benefit to people, my state, or region?" 

b. The tendency to stray away from the basic research objective 
by following interesting or tangential lines of research 
interest. 

c. The pressure to deal with applied aspects and neglect basic 
research; the latter usually demands more knowledge and 
imagination from the investigator. John Dewey stated, "Theory 
is, in the end, the most practical of all things." 

d. Too many projects leading to inadequate financial support, 
insufficient personnel, and. diluted resc-arch leadership. 

Use as a guide professional man years for each category 
of personnel; project leaders, technical assistants, 
graduate students; a worthwhile project usually requires 

a minimum of 0.5 professional man year (p.m.y.), 0.5 m.y. 
technical assistants, and 1 or 2 graduate assistants. A 
project involving 1 p.m.y. requires about $20,000 for 
personnel alone, and a total of from $25,000 to $35,000 
of funds to provide for technical assistance, supplies 
and travel. 
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e. Failure to complete and publish results. 



6. The use of lay advisory committees to advise on research needs 
and to aid in the evaluation of research is currently popular. 

. This device is useful, but each group needs to know its mission 
•* ( advisory ), and the research leader must assume the responsibility 
to (a) use a committee once it is formed, and (b) to bring under- 
standable and pertinent questions before the group. Advice from 
a committee needs to be evaluated and, uJ.timately, the committee 
will want to know what happened to its suggestion. 



preceding page blank- not filmed 

procedures ai^d techniques for the administration of research 

by 

Calvin J. Cotrell 

Assistant Director for Vocational Education 
American Institute for Research 

Pittsburgh, Pennsylvania i 



As a member of this panel, I represent private non-profit research in the 
behavorial sciences. I am employed by the American Institutes for Research of 
Pittsburgh, Pennsylvania, which was founded in 19^6 by Dr, John C. Flanagan, 
who has served as its, president. The firm currently consists of approximately 
23 ? regular full-time employees. 

As indicated by its title, the organization is divided into several 
institutes and programs. Some of these are: 

International Research Institute 

Institute for Performance Technology 

Institute for Research in Education 

Military Assistance Institute 

Cross-Cultural Research Program 

Measurement and Evaluation Program 

Among its many and diverse research activities, A,I,R, is currently engaged 
in several vocational research projects which are being sponsored by the Ford 
Foundation, Vocational-Technical Division of the U. S. Office of Education, and 
the Office of Manpower, Automation and Training of the U. S. Department of 
Labor. 

Is vocational research needed ? There is an imperative need for research in 
vocational education. Successful business and industry have for years depended^ 
upon research as the foundation for the development of saleable products. Millions 
have been spent :^’*or this kind of research, but what have we done in Vocational 
Education? There has been very little research in this area. Then what have we 
used as the basis for the development of successful products in our schools? 

We have been accused of relying upon armchair logic when other support was needed 
to establish sound programs. As an example of effort in one phase of vocational 
education research, however, there have been some one-year follow-up studies of 
vocational school graduates. This is helpful but it, nevertheless, falls short 
of being a continuous follow-up to develop data on employment factors other than 
placement. It is essential to have some evidence on job progression, job 
security, and other factors of employment performance which have to be measured 
over a longer time span. 
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How do we get the right people to recognize all of the vocational research 
needs ? For one thing we may have some state directors of vocational education 
who do not appreciate the need for research. It seems they are going to have 
to undergo some "arm twisting." 

The utilization of advisory committees by those responsible for research 
may be an effective approach to convincing the proper authorities of the need 
for vocational education research. I would see both general and specific area 
advisory committees utilized. By a general advisory committee I mean one con- 
sisting of representatives of all the vocational services or functions of voca- 
tional education. These would be vocational agriculture, distributive education, 
home economics, trade and industrial education, vocational guidance, post- 
secondary vocational-technical Education, and others less traditional in nature. 
Specific area advisory committees could be organized in any of the areas men- 
tioned. A representative of each of the specific area committees may serve on 
the general advisory committee. 

How do you evaluate research ? Assuming that the final report is sound in 
terns of content, including proper and accurate statistical treatment and good 
writing, there would be at least three major concerns: 

1. The project must have been completed in accordance with the 
requirements of the contract. 

2. Something new should have been learned while completing the 
research which is beyond the requirements of the contract. 

(a new technique developed or a new approach tested, ) 

3. The project should be recognized by appropriate audiences as 
making a contribution. 

How do you obtain staff ? Provide an atmosphere conducive to research which 
allows sufficient freedom but adequate supervision and advisement. Comfortable 
facilities will help, but more important would be the encouragement and the 
practice of good human relations. 

Employee benefits, such as paying for moving expense, non- contributory 
retirement plans, life insurance, hospital-medical insurance, and other benefits 
will help in attracting staff. 

Perhaps the most valuable feature facilitating employment of staff would be 
the provision for flexibility in salary schedules enabling the administration to 
attract and employ competent researchers. 

Provision for employing consultants should be provided in all contracts in 
order to provide for specialized staff needs and to provide part-time staff in 
the event of difficulty in locating permanent staff. 

There should be provision in the research organization for various kinds 
of supporting staff. The lack of secretarial, graphic arts, and other supporting 
staff essential to research activity has beenl^own to discourage prospective 
candidates from accepting positions offered by some research organizations. 



PROCEDURES AjND TECHNIQUES FOR THE ADMINISTRATION OF RESEARCH 

by 

Egon G. Guba 

Director, Bureau of Educational Research €tnd Service 
The Ohio State University 



It is, of course, a difficult matter to summarize one's contribution to 
what was essentially a conversation between five people. I would like to pull 
together the major points that I "cried to make with regard to what I believe 
were the five major problems or questions addressed by the panel. 

1. How do you present the "story" of your research agency to 
its public, particularly its sponsors? 



Every research agency has a variety of publics with different interests to 
serve and with different perspectives within which they view the work of the 
organization. u‘or my agency I can distinguish at least three such publics: 
the political community, the research community, and the practitioner community. 
Each requires different kinds of "data." 

The political community is not much concerned with the substance of what 
we do as \i±th the number of persons we reach in some way and with whether those 
persons we do touch have a generally favorable impression of our work. Thus, 
it is a political datum to be able to say that we worked in 43 of the 88 Ohio 
counties last year, or that we received 276 letters of praise from persons who 
attended our regional custodians' workshops. 

The research community is concerned with whether or not our work meets 
minimal, standards of scientific rigor and whether or not the results of our 
research make a contribution to knowledge. Our list of publications, a 
description of the areas within which we are working, and statistical tables 
of our findings are data of interest to the research community. 

The practitioner community is concerned with applications we can make 
of our research to their problems, or the consultant help that we can render 
to them as they seek to develop solutions to their action problems. The 
nature of our services, the ease with which they can be obtained, and the 
practicality of our recommendations are typical data of interest to the 
practitioner community. 

Obviously all three communities are crucial to us. We need their under- 
standing and support and we need to give them an opportunity to influence our 
work through their suggestions and criticisms. Channels of communication, as 
through advisory boards, must be kept open. We must also remember, however, 
that each represents a quite different interest, and that these interests may 
at times be in conflict. 
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2. How does the research administrator relate to his personnel? 

Like all administrators, the research administrator must constantly tread 
a thin line between telling the researcher what to do (an institutional program) 
and supporting the researcher in what he wants to do (an individual program). 

Where we loiow what we don't know, we can set up a program to find out, and under 
such circumstances an organizational program makes sense. When we don't Imow 
what we don't ]mow, we must largely rely on the researcher's own instincts to guide 
us (the "green thumb" researcher, as one participant suggested). In the latter 
case we must be especially careful to provide extant psychological support, for 
there is nothing more anxiety-producing than to be on a road whose direction is 
unlmown, and. whose end may be useless of attainment. The research administrator 
must know when to allow the researcher to push on and when to call a halt. I 
d.on't Icnow of any good operational indication that teHs one when to select each 
option; however, the research administrator who doesn't have a good "sixth sense" 
in this area won't remain an administrator long. 

3. How is a research program evolved? 

In every area, as I have already implied, there are things we know that we 
don't know, and other things we don't know that we don't know. A program must 
have flexibility to permit movement in both these arenas. In the former case, 
it is convenient to sketch a kind of "cognitive map" that will soon pinpoint 
the areas in which our knowledge is impoverished, and we can push ahead, in a 
programmatic way to resolve these. In the latter case we must rely on our 
insights, on our feelings of unease or disquiet, and even on serendipities to 
push on. 

4. How does the research administrator evaluate the work of his 
agency? 

There are a number of very operational criteria that all of us apply: do we 

stay within the limits of our budgets; do we stay out of trouble with the auditors; 
is our work accepted for publication, and if so, are reprints requested; can we get 
follow-up grants; and the like. Insofar as the work fits into a program, we can 
ask whether closure has been obtained, whether a "no-knowledge" area on our con- 
ceptual map has been closed out, and whether the research is heuristic, i.e., 
whether it opens as many new questions e»s it answers. 

One criterion which many people wish to apply is whether the research leads 
to any practical application. This is a criterion which I resist stoutly, unless 
it is the avowed intention of the project being evaluated to produce such an 
application. Generally, the researcher’s function is to produce knowledge; 
while I may hope that that knowledge might sometime be applied, I believe it is 
a subversion of the researcher's time and talent to require him to achieve those 
applications . 

If applications are desired, a special development and diffusion unit 
should be established to be responsible for them. We have been particularly 
lax in education in setting up such mechanisms intermediate to research and 




75 









I 



practice, apparently on the assiui 5 )tion that applications occur automatically 
once knowledge is given and an alert practitioner is properly motivated to 
improve his lot. Agriculture has known for almost a century that this is not 
enough— -the Agricultural Extension Service is a splendid example of such an 
5.ntermediate agency. We need a similar mechanism in education. 

5. Is proposal writing necessary and desirable? 

That proposal writing is necessary is clear from the fact that it is on 
the basis of proposals that grants are given. It is often argued that it is 
not a desirable activity, however. A colleague of mine recently estimated 
that foully a third of his time was given either to writing proposals or to 
evaluating proposals written by others. What a waste, he implied! 

I do not agree with this position. My own experience in reading and 
evaluating proposals leads me to believe that researchers are troubled by 
a considerable amount of muddy thinking. I am sure that only thirty to 
forty per cent of the proposals that I read have even a reasonable problem 
defined, and many of these subsequently fall down because their objectives 
or procedures are not matched to the problem. 

I believe that proposal writing, when viewed not as a chance to get 
money but as an opportunity to order one's mind about the research tu be 
done, can be of great benefit. The discipline it imposes on the mind is 
more than repaid by the greater effectiveness and efficiency of the subsequent 
research activity. I strongly urge that we continue to insist on well- 
disciplined project proposals, even if we devise other ways of funding, because 
of the great positive effect on the researcher's mind. 
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PROCEDURES AM) TECHNIQUES FOR THE ADMINISTRATION OF RESEARCH 

i^y 

Robert L, Burton 

Laboratory Director, Circleville Research and Development Laboratory 

E, I. DuPont de Nemours and Company 
Circleville, Ohio 



I am pleased to be here; I hope that I can be of some assistance to you by 
bringing to you the outlook of an industrial laboratory. . The Circleville 
laboratory of the DuPont Company includes about one hundred fifty people of whom 
about forty are technically trained. Our funding, of course, is entirely private; 
we seek money from no one other than our own management. We spend our money within 
our own company, that is — we do very little research with other research organizations. 
Our budget is between three and four million dollars a year, which is directed at 
providing the scientific and engineering basis for maintaining our position in the 
field of plastic films, which have a variety of both industrial and packaging uses. 
Again, as this organizati^on is substantially different from yours, I hope that , 
perhaps I can bring some' new points of view to you. 

(The question has been asked by Dr. Bender on how personnel responsible for 
research at DuPonc get more money allocated to research.) I think that a key to 
this, on the part of the director or administrator of research, is to have clear, 
understandable objectives. Now, I want to emphasize "understandable." These 
objectives should be understandable, not to the scientific community who will be 
doing the research, but rather to those people who are responsible for the 
expenditures and for the results, who will eventually want to see something change, 
as a result of the research! There is no better way to get a proposal killed than 
for me to present to my management a dissertation on electron-bonding, or a 
discussion of pi-electrons. This does not mean anything to the people. The thing 
that is important for ^ to do is to talk about earnings which can result from 
achievement of certain objectives. If I propose to develop a polymer that will 
stand up at a thousand degrees centigrade and which is needed in jet airplanes, this 
can be understood as a business objective, but if I launch into a dissertation on 
how I am going to study high temperature polymers in terms of purely technical 
activities, I do not sell the objective. So, let me make a real point ... make sure 
that your audience understands your objectives. 

(in that case, who is the audience?) The audience consists of the man to whom 
you are selling the program. Now, if I am talking to the president of the comx)any, 

I may talk along one line; I would not use those same presentations to talk to 
people whose interests are primarily scientific! You have to have clear, under- 
standable objectives in tenns of your specific audience. Now, I guess in your case , 
you are going to be dealing with a heterogeneous group- -political people, educational 
people — I think that you have to tailor-make your presentation. 

(Concerning the use of advisory committees which has been under discussion today) 
let ine nmike just one point. With the use of advisory committees, I think that it is 
very important for an administrator not to let himself get trapped by the committee. 
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so that he is forced to accept their recommendations. You should use them as advisory 
commit cees, dealing with them in such a way that you are not committed to accepting 
their advice. Otherwise, as an administrator you have lost control of your activities 

(Concerning recruiting staffs and establishing staffing patterns for research 
programs in industry, keeping, in mind the conflicts which arise between research 
personnel and management personnel, Dr. Burton had this to say.) Certainly, we are 
trying hard to recruit people, and there is Just tremendous competition; I think 
that this is universal. Actually, there is not a shortage of bodies — there is a 
shortage of minds, and this is the reason that we all are competing for the top 
five, ten, and fifteen per cent of the students in any field. But, I want to go 
back to Egon’s point on this conflict betv/een research and management, which is a 
perpetual subject for discussion. There is a concept which I think is very helpful 
to research administrators, and that is to recognize the difference between what 
some people call "functional control," and "operational control" of the people in 
your organization. By "functional control," you provide objectives. You tell them, 
"where, we should go," "what do we want to do?" Then you say to your researcher: 

"All right, now get me there I You pick your methods and tools. I will support you 
as needed, but you must get me to the objective." And, if you tell the man this, 
and if he accepts that objective, you are in good shape, providing he has the ability 
to pick the route and to execute the program. Obviously., some checks, and conttolS 
are needed. 

In "operational control," on the other hand, you tell the man: "This is where 

I want to be, and this is Just how I want you to get there." And, brother, you are 
in trouble, when you ^ this, when you practice operational control of competent 
research people. Because, as a matter of fact, it is Just barely conceivable that 
they may have better ideas than you , and they Just wi 11 not follow your route . 

Further, they will feel that they are cogs in .the organization, instead of being 
vital, important, creative parts. I think that it is very important, again, for 
any administrator to say to himself; "Now, what kind of control am i providing — 
functional or operational?" 

(When asked how industry knows it is getting its money’s worth in research. 

Dr. Burton commented that:) In some respects, industry is a little easier. If I 
can turn to our profit -and- loss sheet; and see that new products developed in our 
research laboratory are selling and making money, I can say that Whs money well 
spent. However, the problem is that it frequently takes so long to get things to 
a profitable position that you have to get some intermediate measure of effectiveness. 
The thing that I personally do is to examine my environment and see if things are 
changing as a^ result of our work. When I say, "things .changing, " I mean a variety 
of things. If new facilities are appearing, this is change, and if it has resulted 
from our work and since there are enough checks and balances including Judgment of 
other people who had to evaluate the work I Judge our research to have been effective. 

How are ideas changing? Have people in other organizations changed their 
points of view; for instance, the sales division, the manufacturing division, the 
management- ^sometimes have different points of view with regard to a specific 
situation. Wow, if research unifies a position, so that salesmen or production men 
change their positions or attitudes, I say, "Great, we have, done some good research." 
So, I think a good measure is positive change in ideas, facilities, profit and loss. 

If the same people continue to sit around the same old table, talking about the same 
old ideas, except asking for more money, you do not have very good research. 
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There are people who are dedicated to maintaining the status quo, who are 
afraid of the new, and who do not want to learn a new way. If a man is making his 
living teaching kids how to read Braille, he could see this thing as a personal 
threat to his security, and so resist the change. Good research must include 
preparation for the utlization of the research. Frequently, the researcher by 
himself cannot do this, but it is the responsibility of the research administrator 
to see that this vital part of the work is done by appropriate people. 

(l^en questioned about what should be the nature of a research proposal the 
following comments were made.) Within DuPont Company, research projects are^made 
in one page; if I send off a two-page project, it will come back unsigned and 
unread as being "too long." This is independent of the project size. I sent off 
one the other day for $700,000 which actually was less than a page, and it was 
authorized pronptly. I think that the key thing was that I prepared the audience: 

I stated the business objectives, and I stated the technical objectives which had 
to be achieved to acconplish the business objectives. The objectives were accepted 
and since management had confidence that my organization had the scientific competence 
to do the Job, that was it. 

(The question was asked, "Even though you said that you sent away one page, you 
must have had something of more than one page to back it up. In other words, all of 
the thought that you have given to this, in terns of the planning, does not represent 
just one page, does it?/} Well, all right, this is true, and it gets back, I think 
to the key that the organization has to have confidence in its parts. As a matter 
of fact, I perhaps overdramatized this large project. In that case, I had discussed 
the project, but I think that the audience that I had with the key people lasted no 
longer than half an hour. Wow, to get back to some smaller projects which involve 
twenty or thirty thousand dollars, I have had those kinds of things authorized and 
ot]to directors in the DuPont Company can get these things authorized by writing 
things down specifically and( sending them off. I may call the boss and say, "We 
have had an idea and are sending down a project. Look it over and if you have any 
questions, call me," Sometimes I get questions, and sometimes I do not. 

(in closing, Dr. Burton made the following comments which summed up his concerns 
as an administrator of research.) One of the problems that an administrator faces 
15- that of wearing many hats, and I think that it is important for an administrator 
to fecognize and be conscious at all times as to which hat he is wearing. For my 
own thinking, I divide my activities into four areas: First, that of planning; 

second, that of Organizing; third, that in Leading; and, fourth, that in Controlling. 
Now, ray relationship to the organization is quite different. as I am consciously 
exeicising these different functions. In the Planning session, there may be a 
great deal of exchange ... I need to be open, receptive to all of the ideas in the 
organization. At some point, though, there comes a time for decision. In Organizing, 
again, this is a case where the administrator needs to lay out what needs to be done, 
to accomplish the results.. And in this regard, let me say that I recommend very, 
very highly^ (the use of) arrow- diagrams or pert Charts for both Planning and Control. 
It is also inqportant that after you make them, you review them regularly to see how 
you are doing and to make appropriate changes. The third function is this one of 
Leading; this is extremely in^ortant. In this regard ... achieving enthusiasm for 
attainment of the organizational objective is most helpful in getting maximum 
productivity from researchers. This gets back to the concepts of operational and 
functional control. Then, there is this fourth function of Controlling — when you 

are finding out whether the money has been well spent, whether the budget is over 
or under, and so on. 

I have found these concepts to be very useful and recommend them for your 
consideration. 
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The advent of 11.8 million dollars for occupational research and planning 
makes it crystal clear there are problems needing solution. Today, there are 
some 1,200,000, about as many as make their living producing automobiles, planes, 
and. ships- -working in the invention industry called "Research and Develox^ment" 

(Velie , 1965). The research capabilities of ed.ucation, in contrast, number about 
3070 (AERA^, April, 1964) and education, too, employs about as many persons who 
make their livelihoods manufacturing automobiles, planes, and ships (NEA3 February, 
1964). In vocational ed.ucation, Evans (1963) pointed, out a little ooer a year ago 
that we approximate fewer than one hundred, competent researchers. It is no wonder 
then that we are here today to examine and. strengthen our determination to mount a • 
more adequate program of problem solving. 

Wanted- -Vocational Innovators 

Few would disagree that we need, more problem solving. But we solve problems 
every day, so why so much fuss about needing research? The answer is quite simple. 
Eoucators as a whole and vocational educators in particular are quite naive when 
it comes to sophisticated, problem solving. Educational researchers communicate in 
a jargon somewhat unfamiliar to the average vocational ed.ucator. For example, a 
"hunch" is a hypothesis, a "design" is a procedure, and. a "variable" may be a 
number of different things, many of which can't even be accounted, for. "Reinforce- 
ment" is not something put in concrete to make it stronger, and. "control group" is 
not how well the teacher disciplines a group of students. These and. many other 
terns are going to be found more frequently throughout the professional literature, 
because educators are becoming research minded. 

To imply that vocational educators are not problem solving minded would cer- 
tainly be incorrect. However, to say they are research sophisticated would also 
be a mistake. Enough formal research just isn't in evidence in vocational education. 



^Velie, Lester, "Wanted - One Million Innovators in Science," The Readers 
Digest , April, I 965 . 

^American Educational Research Association, Newsletter . Vol. XV, No. 2, 
April, 1964 , p. 1. 

National Education Association, "School Statistics, 1963-64." National 
Education Association Research Bulletin, February, 1964, p. 2. 
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From the .conception of the Cooperative Research Program (Public Law 531) voca- 
tional education has had less than a dozen studies approved for grants. Under 
the 11,8 million dollars in the Vocational Education Act of 1963 > proposals 
submitted by our own people are conspicuous by their absence. Only a handful 
of formal research staff studies have been going on over the years. Few voca- 
tional teacher education institutions even consider releasing staff members 
part time to do research as is often done in other disciplines. The bulk of 
vocational education research has been at the graduate student level, and, even 
here tne number of studies leaves something to be desired. 

4 . 

Lawrence W. Prakkin (April, I965) points out in an editorial entitled "To 
Keep the Faith": 

Changing of habit patterns of long standing is diffi- 
cult and disconcerting. Problems of curriculum, courses 
of study, equipment, facilities, and staff are compounded 
by the new and broader approach vocational ed.ucation can 
take with the new resources as its command. Adding these 
new responsibilities does not mean that the old programs 
are bad- they just are not enough to do the present-day 
job. We will have to live with change if we are to meet 
our obligations and make every effort to adjust to new 
requirements, new administrative organization and changing 
responsibilities. 



Change in our field is a must, but to know what changes produce what results, 
and why, are the keys that need to be accounted for through researca, 

I have been asked to discuss with you the development of a proposal that was 
funded. This applies success in one way or another. The particular proposal I 
am drawing my experience from is really not important, but to satisfy the curious 
it is entitled, "The Preparation of Youth for Effective Occupational Utilization," 
and was funded by the Cooperative Research Blanch for a two year period at an 
^ount of $201,000. In other words, it is a sizeable undertal^:ing and even now 
has a number of oeople involved in carrying it out. The anatomy of this experi- 
ence is pertinent to bhose of you here. So from here on I am referring to the 
process, the stumoiing blocks, and the hazards of getting involved in this busi- 
ness of putting together proposals. 

The Incubation Period 

The incubation period represents the starting point. Frankly the article that 
appeared in Harper *s Magazine by Edward Chase^ (April, I963), "Learning To Be Unem- 
ployable" annoyed me to tl|^e point of wanting to look at vocational education in a 



^akkin, L. W., "To Keep the Faith," School Shop , April, 1965. 

Edward T., "Learning To Be Unenployable , " Harper *s Magazine , April, 

19o4j p# JLe 




more positive light than he did. After all, those of us in the business certainly 
knov’’ where to look to find the dirt, and Chase had pried into some of our darkest 
corners. 

It so happened this particular article and the study by Mary Kohler^ (1962) 
which focused on some of the problems of vocational education in New York City 
hit print abou^ the same time, thus giving double rednforcement to my desires to 
study vocational education from a more positive setting. 



I casually mentioned the repulsiveness of these two readings to a colleague 
of mine*^ at lunch one day. The interesting thing, this chap is a labor economist, 
and it took such a conversation to learn that labor economists are interested in 
our problems. Anyway, shouldn’t they be when you come to think about it (which I 
submit may be new to you also). Well, immedictely we had a point of mutual interest 
and one that took on dimensions of an interdisciplinary nature.® The more we began 
exploring our joint interests, the more obvious came our individual strengths and 
weaknesses relative to this whole business of man, education, and work. It should 
be obvious to you that such a team approach focusi]p,g on any problem is pretty hard 
to beat. This I am sure was one of the strengths of our proposal. 



During this incubation period we held many discussions in order to delimit 
the problem so it could be properly attacked. Naturally, put two heads together 
and there is never going to be entire agreement, but the team concept will prevail 
if the overall goal is of mutual interest. 



At the same time we were thinking of sources of funds to conduct a sizeable 
study. Now at this point I pause to remind you that nothing ever prevented the 
vocational education leadership to use a sizeable amount of state and federal 
monejf' for research, but this never occurred to us. Just being aware that now 
there are several sources of funds is mighty important. My colleague had some 
experience with the Ford Foundation, and we knew they weren’t buying anything of 
this type at the moment. I had recently received a grant from the Cooperative 
Research Branch, so I knew they were interested in vocational education. It 
was, therefore, natural that we couched our format in the Cooperative Research 
style. Incidentally format is important. If we had chosen the Ford Foimdation 
track, our style would have been much more of the essay nature with greater 
emphasis on the development of the problem and less on i',he procedure. 



'^Kohler, Mary Conway, Youth and Work in New York City , New York, New York, 
Taconic Foundation. 1962. 

"^Kaufman, Jacob J., Professor of Economics, The Pennsylvania State 
University, University Park, Pennsylvania. 

8 

°Not that education is a discipline, but rather that educators can work 
with the disciplines on mutual points of concern. 
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Pew realize the tremendous amount of time involved in preparing or writing 
a proposal. And let's keep in mind the competition for funds is great, so what 
is submitted in the way of a few written pages (usually I 5 to 20 single space 
typed) has to be good. Therefore, the dichotomy of the task when more than one 
person is ^actually preparing a proposal was our next problem. !Ehe "problem 
statement" was definitely a joint endeavor as were the objectives. The review 
of literature section was facilitated by each of us having kept a card index on 
our readings; these being turned over to one individual to develop. The proce- 
dure section grew out of our .discussions and was written by one of us. Thi.^ 
left only the budget and here we looked into a crystal ball for something that 
seemed logical in terras of the size of the project. 

Other aspects which we were sensitive about dealt with internal university 
mechanics. We were in different departments, in fact in different colleges. 

This proved to be no problem as most college or university administrators are 
surprising agreeable to having the disciplines work closer together. Moreover, 
most higher education institutions have a contracts officer who can be of * 
immeasurable assist^ce in preparing the budget phase of the proposal and can 
help in expediting it through proper channels. I'm sure it doesn't surprise 
you to know that colleges and universities are set up for receiving and admin- 
istering grants much better than most State Departments of Education® I think 
our friends in the physical sciences have had something to do with this as they 
have been bringing research money to campuses for quite a few years. 

The Prenatal Care 

I cannot repeat too often that the writing of proposals takes time and is * 
in itself costly. It is, however, the gamble one takes if seeking outside 
grant funds. The importance of this step should be obvious to those of you 
here because we all know to begin any project without a well thought-out and. 
developed plan is tantamount to failure. We in vocational ed.ucation have been 
guilty of this whether we'll admit it or not. The pressures often seem so 
great tnat we are forced into action before the master plan is developed. We 
tend to rationalize this by the statement that we are "men of action," but I 
wonder how much further we would, have been advanced if we had taken the time, 
to get tne facts to back up some of our actions. Actions which incidentally 
even now are being challenged. I, for one, respect the awarding of grar.its on 
a well thought-out proposal. 



Tne prenatal care of the proposal which I am describing was one of not 
only writing the several drafts but getting the department chairman to be 
sympathetic to devoting load, time to the activity. Proposal writing on a 
moonlighting basis cannot be expected you are really interested, in research. 

It must become part of the job and time for it to be done adequately must be 
found , 



The .typing of several 
taken into account and, the 



drafts is a clerical consideration needed to be 
final duplication and. collation with its thirty or 
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considerable work load. From my experience, the climate 
for these aetails is much greater at the college or university setting than 
again in State Departments of Education. ^ 

t ^his point should be said about timing. One of the early bits ' 

cut-off date(s) of the agency to which you are 
planning to submit. In some cases there may be only one such date per year. 

The Sears Roebuck Foundation firms up their budget once each year: the 
Cooperative Research Branch three times a year; and the Vocational Education 
Act Of 19o3 IS operating on about a three month cut-off. The dates of 

provide a target time in which to get the proposal firmed up. It's 
far better to skip a cut-off date than to hastily put together the proposal. 

.•n in mind whatever you place in the budget will have to be negotiated 

in contract form, even if the proposal is approved. Therefore, know how you 
arrived at your^budpt figures. Then, too, you should be aware that there is 
sea tern as efficiency of budget." A good proposal can be thrown out 
eca se the budget is unreasonable. At the same time an underpriced budget 
calls attention to the naiveness of the submitter. The overhead rate (usually 
20 per cent for U. S. Office of Education funds) is expected to pay for something 

university contribution. The asking for desks, Lairs, and 
t^ewriters; in other words, routine pieces of office equiument waives a red 
ilag in the eyes of some review panelists. Graduate assistants are a Legitimate 
part of any research undertaking. However, to assume a single proposal is going 
to buy enough graduate students to put a department in the graduate program^ 
business for a long time is also unrealistic. ^ ^ 



it? P^iucipal investigator himself should be well aware that it 

talent that is being bought. So, it stands to reason when a budget is 
exarained. only to find the principal investigator devoting less than one-fourth 

^l-in-all, the prenatal care period, of this anatorr^ is one of hard work, 

genuine relief when the pronosaL is packaged up and 
shipped off. Our project had an interesting turn of events when I decided the 
pastures were greener over at Rutgers and left Pennsylvania State just prior 
to the time of submission. 



The Delivery 



“Kie waiting for a reply can be a frustrating experience. The delivery of 
this information c^ take three months or longer. As an experienced father will 
usually indicate, the first one is the most difficult to swLt out. PremonitiL 
IS usually woitnless at this point. 

4 .V. 4 . l^s^aUy happens, one needs a little time to relax from the tensions 

that have been built up during the prenatal period, and it will take at least a 
few months before psychologically you are ready to try another one. Meanwhile, 

you have had will have stimulated your thinking along other problems 
and other research. This is why researchers seem to be such Learners: walking 
around with their heads in the clouds hardly speaking to their colleagues. 
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In due time some response to your submission is received. This may be 
quite emphatic, especially if you have dealt with one of the private foundations. 
Yes, we ^e interested or no we are not. The U. S. Office of Education funding 
agencies will deliver in a more subtle manner. A stands for approval and all is 
"rell. P. means provisional approval and some small changes must be made. R indi- 
cates you are being encouraged to resubmit, but possible major revisions will be 
needed. D means disapproval and you might as well look for another problem or 
try pother granting , agency. Aud H is reserved for ’’hold,” as there is something 
lacking in the proposal or more information is forthcoming. The healthy baby is 
^ out-and- out approval. But don't get too discouraged if you end up* 
some minor changes or even are requested to resubmit. These 
are hope! ul signs and the tape kept from the review panel discussions may be 
most helpful in revision and resubmission. Assistance in this respect comes 
from the person who is monitoring your proposal. 



If a contract is witten, have the ammunition to back up your original 
budget request. A lot can happen between the time the proposal was first 
submitted and the writing of the contract. Don't hesitate to ask for additional 
s^s (usually small) which you may have overlooked. On the other hand, don't be 
afraid to reduce your budget request on unrealistic items which the monitor may 
point out to you. Reach a satisfactory agreement to both parties and by all 
means if you have any doubt, plan to have the university contract official 

point that should be made quite clear. The usual practice is 
hat the research grant is the right of the researcher and not the institution 
o w 1C e researcher is attached. This is to say, if the researcher (princi- 
^ j ijivestigator) moves, he has the prerogative of taking the grant with him 
^d the funding agency will usually back him up. He is what they bought in the 



In Conclusion 

In tu-o short a time I've tried, to relate one successful experience to 
you. ^ For each success there may be a number of failures, but this is part of 
tne learning by doing" in which we all believe. We have pointed out the long 
way vocational educators have to go to develop a real research capability: 
we ve jried tc indicate an interdisciplinary approach to our problems is looked 
upon wlth_ favor; we've traced seme of the steps in proposal preparation, and 
we ve called attention to those of you who will administer the vocational pro- 
gram of research tnat this is not a moonlighting business-- that we must get 
geared up to the job in terms of competent personnel, time, and financial 
assistance. The end product though will add a blue chip stock to your holdings 
which will pay dividends long needed by vocational education. 

In closing let me say, we are on the move. We'^ve had. some success already 
and. we must keep in mind, that it is far more p referable to do a few things well 

things in a haphazard manner . Voc ational educators mus t 
administer their resea r ch programs well even to the extent of starting out on a 
very small scale. Fo r whatever we do must reflect in the quaTity o f our prod.uct 
no*b xn 1sli6 ni8*ss pro (311013X011 of mors of thG sqdi6« 
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INTRODUCTION 

Education is fast changing and administrators of educational organizations need to 
alter their styles, methods, and structures to keep in tune with the times. I wish 
to review certain investigations dealing with change in education, and. to point out 
some of their action implications for you. 

Further, to you who are in positions of responsibility dealing with educational 
research, I'd like to suggest a fruitful topic for needed studies: research on the 

diffusion of educational innovations. 

We spend tremendous resources in education in developing ed,ucational innova- 
tions and additional thousands in inducing local schools to adopt them, yet I know 
of only one U. S. educational researcher who is entirely devoted to the scientific 
study of how these new educational ideas diffuse. We seem surprised that kinder- 
gartens requir »d over 50 years to reach widespread adoption by public schools, and 
similarly are fascinated that language laboratories increased from about zero in 
1955 to over 4,000 i« 1962, yet we know little about how either innovation was 
communicated and adopted. 

A theme of my paper is that we need to devote increased research attention to 
investigation of the process by which educational innovations diffuse. Such research 
investment vail pay off, I predict, in speeding the rate of adoption of these ideas; 
it vrill also, as bonus, add to our fundamental understanding of human behavior, 
especially that dealing with communication and change. 

Objectives of this paper are to: 

1. Point out the evident increasing rate of change in U. S. schools. 

2. Trace the major research traditions in past innovation diffusion 
studies. 

3. Speculate about how the nature of the educational institution 
likely affects applicability of past diffusion research to the 
case of ed.ucational innovations. 

4. Describe four types of findings from past studies dealing with 
(a) the innovation process, (b) adopter categories, (c) the rate 
of adoption, and (d) opinion leaders. 

5. List possible implications for action from educational diffusion 
research. 
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RATE OF CHARGE 

Figure 1 shows the rate of change for three educational innovations. These 
data, suggest an increasingly rapid rate of change. This faster rate of educa- 
tional diffusion may be due (l) to the ethos of the post-Sputnik era, with an 
increased emphasis upon the importance of education and especially upon certain 
school subjects, NDEA and foundation support for innovation, etc.; (2) to other 
concurrent changes from the 1920' s to the 1960's like improved travel and mass 
communication, more professional school staff, etc.; and (3) to differences in 
the innovations themselves; for example, better "packaging," greater credibility 
of communication source, differential degrees of upsetting the total school 
structure, financial cost, etc. 

Figure 2 shows how the rate of change in New York state schools increased, 
in the post -Sputnik era. Is there a similar snowballing rate of change in your 
states' schools? 



RESEARCH TRADITIONS ON DIFFUSION 

One cannot help but be impressed, after reviewing the same 732 available 
publications on the diffusion of innovations, with the amazing similarity of 
findings by each of six major research traditions, which was accomplished in 
spite of the great lack of awareness by each tradition of the others. One 
would least expect this occurrence aiaong researchers stud.ying how Ideas spreadi 

The six major traditions are: 

1. Anthropology , where typical studies are concerned, with how 
ideas diffuse from one society to another or with the social 
consequences of technological innovations. 

2. Early Sociology , where S-shaped. ad.opter distributions have 
been found and where some correlates of innovativeness were 
determined. 

3. Rural Sociology , where major research attention has focused 
upon correlates of farmer innovativeness, how properties of 
innovations affect their rate of ad.option, and upon communica- 
tion channels at stages in the adoption process. 

4. Industrial , where industrial economists and. engineers have 
studied the correlates of innovativeness among industrial 
firms . 

5. Medical Sociology , where investigations were conducted, on the 
diffusion of a new drug among physicians, and on the acceptance 
of the Salk polio vaccine. 
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Figure 2. The Rate of Adoption of Educational 
Innovations Increased After Sputnik 
in New York Schools. 



Source ; 

^Brickell, Henry M. , State Organization for Educational 
Change; A Case Study and a Proposal 3 (1964. p. Miles 
op . cit . 
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where studies on the correlates of innovativeness 
^o^ schools were conducted, especially by Paul Mort .and his 
followers at Teachers College, Columbia University. In recent 
years, however, some educational diffusion research has been 

State, Pittsburgh, Oregon, North Carolina, 
and Michigan State. ’ 



THE NATURE OP EDUCATION AS IT AFFECTS DIFFUSION 



resea^ch^boatr^^n°J? ^ bathtub in which to float one’s diffusion 

4-vift+ r.v, 1* there are certain aspects of the nature of U. S. education 

US cautious on applying the results of studies in other tradi- 
tions, such as rural sociology, where the most studies have been conducted. 



1. One difference between agriculture and education is that, as 
Pellejr (1948, pp. I7O-I71) pointed out, "Unfortunately, there 
seems to be no possible profit motive in being an educational 
innovator. The primary motive for more innovative schools 
must come through the schdol staff’s or the community’s desire 
for more effective learning by their children. However, the 
amount that learning increases as a result of adopting educa- 
tional innovations is often difficult to measure. So the 
adoption motives for farmers and educators are different. 

2. pother distinction is that there is no corps of change agents 

in education at all comparable to extension agents, farm dealers, 
and others in agriculture. ’ 



I 



5- Likewise, educational innovations are less clear-cut in their 
advantage over the existing ideas they replace than in agricul- 
ture. Undoubtedly one reason for the relative slowness of educa- 
tional adoption when compared with agriculture, medicine, or 
industry is the absence of adequate scientific sources of inno- 
vation in education. Chemical companies tmd the network of 
agricultural experiment stations provide accurate measurement 
under controlled conditions for a new idea. Farmers, as a 
result, have developed credibility for agricultural research 
as a source of innovations. Education, on the other hand, has 
only campus or university schools, and those classes in the 
nation’s schools willing to cooperate in experimentation. Here, 
first responsibility is to the student, not to research. And 
the results of educational research are often ambiguous, incom- 
plete, and confusing. 

4. Innovation decisions in education may not be an individual 
matter The unit of adoption is often a school system, rather 
th^ individual teachers. For example, many school systems 
establish innovation deadlines for ad, opt ion by all their 
teachers, as is fairly common today in the case of modern 
math. Innovations adopted by social systems rather than by 
individuals are likely to have a slower rate of adoption. 



5 ’ 

Pelley, J. H. , Invention in Education , D. Ed. Thesis, New York: 
Teachers College, Columbia University, 1948, pp. I7O-I71. 
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In any event, educational diffusion occurs within a school 
system, as well as between schools. And in the case of 
innovation diffusion within a social structure, the norms, 
statuses, and formal structure of the system affect the 
process of diffusion. 



A SUMMAEY OF FINDIHaS FROM DIFFUSION RESEARCH 



, 1. • The I.inovation Process 

ij^ovation^ is defined as an idea perceived as new by the individual (Rogers f 
9 2, p. 13). Individuals go through a mental process of learning about a new, idea, 
becoming favorable or unfavorable toward the innovation, and either adopting or 
rejecting it. The innovation process is individual; the diffusion process occurs 
for a social system. No matter v;hat the change, someone in the school district 
proceeds through the innovation process If the change is one involving a single 
teacher using a different method, he will negotiate each of the steps. However, 
if the scnool district makes an administrative decision to try an idea, each 
individual teacher may not go through all the steps of the process. In this 
situation the decision-maker, for example, department head, curriculum supervisor 
or administrator, goes through the innovation process, while the teacher using the 
adopted innovation may jump directly from awareness to adoption. 

Five steps have been postulated in the innovation process: 

1 , 



2 . 

3. 



Awareness - The individual begins to hear of the new idea but 
he lacks information about it. 

Interest - The individual becomes interested in the new idea 
and looks for more information about it. 

Evaluation •• The individual begins to try the new idea in his 
imagination. He tries to determine how it fits 
into his situation and how he co old use it. 



Trial 



The individual tries the innovation in a small 
experiment to test its effectiveness. 



5 Adoption - The individual, after having tried the new idea, 

puts it into standing operational, procedure. 

Currently, I prefer to conceptualize the innovation process in three fundamen- 
tal factions, which are closely synonymous to stages in a process, except that they 
do not always occur in chronological order. 



1. Knowledge (which includes the activity at the awareness and interest 
stages in the "adoption" process). 

2. ^titude Change (The individual probably starts with neither favor- 
able nor unfavorable attitudes toward the new idea, at least until 
after he first learns about it). 



Rogers, Everett M. , Diffusion of Innovations, New York: Free Press of Glencoe. 

1962 , p. 13 . 
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3« Behavi oral Change (either adoption or rejection). I prefer 

innovation process" to "adoption processj" because the former 
implies to me that all decisions must not necessarily end in 
adoption, but could also terminate in rejection. 

Useful generalizations have emerged from past research on the innovation 
process, for example, that mass media communication channels are most important 

in crea i^ knowledge about an innovation, but that personal communication channels 
change attitudes. 



The three functions in the innovation process need not occur in any chronologi- 
cal order, other than that knowledge must occur first. Sometimes, individuals are 
forcea. to adopt or reject in spite of contrary attitudes. The compliance t?we of 
decision may occur often in schools and in other situations where the social struc- 
ture^ exerts great influence on adoption or rejection. Also, further information- 
seeking may occur after the behavioral change stage, so as to reinforce already- 
made decisions. 



2. Properties of the Innovation and Rate of Adoption 

IHie rate of adoption over time varies considerably from one idea to another, 
as pointed out previously. The properties of an innovation, as perceived by 
adopters, affect its rate of adoption. Generally, more rapid rates of adoption 
are characteristic of innovations that: 

1. Have more relative^ advantage over the existing ideas being 
replaced. Innovations like hybrid corn which increased yields 
about 20 percent are adopted more quickly than new ideas which 
have less relative advantage. 

2. Are less complex ; new ideas that are simpler to understand ai*e 
adopted more quickly than ideas difficult to grasp. In educa- 
tion the adoption of a team teaching approach constitutes a more 
involved innovation than one of choosing a new text. 

3* Are more visible ; new ideas whose use and. results are more 
plainly seen are more quickly adopted than those with results 
are difficult to perceive. An example is the increased use of 
the overhead projector. Teachers can readily observe the 
implications of this tool for improving instruction through a 
simple demonstration. 

4. Are more divisib le for trial; new ideas which allow small scale 
sample experiments are more readily acceptable than ideas v/hich 
require a massive shift of effort at once and allow less possibi- 
lity of trial. The decision to teach PSSC provides an example. 

i^^^vator cannot teach one day by the new method and one day 
by the old method, so as to obtain a measure of difference. 
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5. Are more compatible ; new ideas that fit with values and 
attitudes presently held more easily gain approval than 
those opposite to presently accepted, practice. Modern 
math and. PSSC fit current U.‘S. emp’nasis upon science; 
this compatibility with social values undoubtedly speeds 
their rate of innovation. 



3 . Adopter Categories 

Innovat i vene s s is the degree to which an individual is- relatively earlier 
than his peers in a social system in adopting new ideas. Innovativeness appears 
to be a generally consistent type of behavior; individuals who are innovative 
for one idea tend, to be similarly innovative for other new ideas. 

As was indicated in Figure 1, most adopter distributions approach an S-shaped. 
ogive over time. This S- curve occurs because in the early years of adoption of an 
innovation, only a few individuals adopt. Later, the rate of adoption increases 
sharply as a large number of individuals adopt the new idea in each time period. 

At this point, the innovation becomes part of the lifestream of the social system. 
In the last stages of diffusion fewer and fewer individuals adopt in each time 
period, as only the last "hold-outs" remain to adopt. The composite result of this 
adoption behavior is an S-shap'^d. adopter distribution. 

For the sake of easier conceptua.Iization and. understanding, the continuum of 
innovativeness is often arbitrarily divided, into five ad.oijter categories; inno - 
vators , the first 2.5 percent of adopt; early adopters , the next 13*5 percent; 
early majority , the next 34 percent; late majority , the next 34 percent; and. 
laggards , the last I 6 percent to adopt. 

Innovators are venturesome individuals; they desire the hazardous, the rash, 
the avant-garde 3 and the risky., Since no other model of the innovation exists in 
the social system, (at the time they adopt), they must also have the ability to 
understand, and. use complex technical information. An occasional debacle when one 
of the new ideas adopted proves to be unsuccessful does not disquiet innovators. 
However, in order to absorb the loss of an unprofitable innovation, they must 
generally have control over substantial financial resources. 

Their propensity to venturesomeness brings them out of their local circle 
of peers and. into more cosmopolite social relationships. Even when the geographi 
cal distance between innovators may be considerable, they often have been found, 
to form cliques. They are thus like long distance circuit riders who spread new 
ideas as their gospel. 

The description of innovators is sharpened by contrast to that of laggards, 
who are the last to adopt an innovation. Lsiggard.s are localistic; many are near- 
isolates. Their point of reference is the past, and. they interact primarily with 
those peers who have traditional values like theirs. Laggards tend to be suspi- 
cious of innovations, innovators, and. change agents. When laggards finally adopt 
an innovation, it may already be superceded by another more recent idea which the 
innovators are using. While innovators look to the road, of change ahead, the 
laggard has his attention fixed, on the rear-view mirror. 

A sunnnary of characteristics and communications behavior of individuals in 
different adopter categories is found in Table I on Page 95. 
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How do schools like Newton, Winnetka, Shaker Heights, and Cape Kennedy 
differ from their more laggardly sister schools? In short, innovators . . . 

1. Are relatively higher in social status , 

2. Tend to use mass media rather than personal communication 
channels. 

3. Are more cosmopolite j they travel over a wide area and. have 
social relationships outside of their social system. 

4. Exert opinion leadership . Because of their prior experience 
with the new idea, innovators obviously are in a position to 
influence the adoption decisions of their peers. Several 
studies have shown, however, that the norms of the social 
system may act as an intervening variable between innovative- 
ness and opinion leadership. For example, in communities 
where the norms are traditional, innovators are not looked to 
by their peers as sources of advice . 

5. Are viewed as deviants by their peers. 

6. Are wealthier ; the Mort studies (Ross® 1949) found, a con- 
sistently high relationship between the financial resources 
of a school system and its innovativeness, although Carlson 
(1962, p. 340) reported no such relationship in the case of 
modern math. 



4. Opinion Leadership 

In every social system there are "certain individuals who have a relatively 
disproportionate share of influence over their peers' decisions. Opinion 
Lead.ership is the degree to which individuals are sought for information and 
advice. Opinion leaders, when comparejd. to followers, seem to conform more 
closely to the norms of the social system. They serve as role -models for others 
in the system. ‘Individuals tend, to interact most with others who have similar 
characteristics, values, etc. Thus, we find that the innovator is often too far 
ahead of the rest of his social system to offer a good, model; opinion leaders 
are more often early adopters. 

Some of these patterns of influence and opinion leadership can be observed, 
in Figure 3j which deals with the. spread of 2,4-D weed spray in one Midwestern 
Rural Neighborhood.. Undoubtedly, somewhat similar patterns of influence about 
an Innovation occur among teachers in a school. 



®Ross, Donald H. , A^inistration for Adoptability , New York; 
School Study Council, 1949. 
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Fi^re 3. Patterns of Influence in the Diffusion and 
Adoption of 2,4-D Weed Spray Among Fourteen 
Farmers in One Midwestern Neighborhood. 5 
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R"™! Sociology Subcommittee for Diffusion 
of Farm Practices, Adopters of Hew Farm Ideas: Characteristics 

Smcr™9to " Losing: Michigan Extension' 
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IMPLICATIONS FOR CHANGE AGENTS 

Certain implications may be drawn from past diffusion research that may 
be useful to administrations of educational organizations. 

1. Selection of "Good" Innovations 

One important role of the educational change agent is to select good inno- 
vations, and discard those innovations which will be inappropriate for his 
clients to adopt. In this role, the change agent plays the task of "gatekeeper," 
which he should be qualified to do on the basis of his superior training, 
expertize, wide communication contacts, and access to other experts. 

2. Developing Ability of Clients to Evaluate Innovations 

Too often, change agents simply seek to promote widespread adoption of inno- 
vations, rather than to try to increase the ability of the members of the client 
system to evaluate innovations. This tactic may mean that change agents would not 
use "innovation bribes" to influence schools to adopt language labs and other 
experimental projects. Ra.ther, these change agents would seek to provide their 
clients with basic understandings underlying the nature of the innovations they 
are promoting. 



3 . "Packaging" Innovations 

Change agents can often achieve a more rapid rate of adoption for a given, 
"good" innovation by packaging it in certain ways rather Jbhf/n others. In 
essense, this approach seeks to use the characteristics of innovation (for 
example, relative advantage, eompatability, etc.) to achieve a more rapid rate 
of adoption. An example, perhaps, might be found in the case of modern math. 

By labeling this idea as "modern," its sponsors undoubtedly newness.’ One might 
wonder, how "modern" will our modern math be 25 years from now? 

Another example of packaging is the change agent who "ties in" an innova- 
tion with a bundle of related practices. Perhaps one of the best examples is 
the India "pankage programme," in which farmers are urged by change agents to 
adopt a complete package of fam innovations, including fertilizers, improved 
seeds, irrigation, etc. 



4. Working Through Opinion Leaders 

Figure 3 illustrated the importance of working through opinion leaders. 

One can imagine tne grtea-tter effectiveness of a change agent who concentrates his 
attention upon farmer number '"2" in Flgufe 3»* 

To some extent we could use demonstration schools as opinion leaders in 
education. Demonstration schools will be effective in diffusing educational 
innovations to the extent that these demonstrators are similar to the schools 
we are seeking to influence. This is. one reason why university schools and 
lab schools are largely ineffective as demonstrations, and are often being . 
discontinued in the U. S. They had largely become elite schools for the educa- 
tion of intellectually-talented faculty children. This eliteness destroyed 
their credibility as demonstrators. 
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innovation in practical school use? ^ ^ showing the same 



5. Basing Prograins on Heeds 

“.ri“:«£rg r-‘°" *" 

Generally, innovations will be adopted more readily and pemanentLv if ihPir 



6 Anticipating the Consequences of Innovations 
cpp-of should anticipate the consequences of an innovation in his 

n 

out to'^havrSndfsiLb^ turned 

Is about the same occurrence not involved in the case of certain ednpsi-i nn^i 
innovations which are only fads or fashions? certain educational 

them out ^tiolpate the undesirable oonseduenoes of innovations is to try 

tnem out in pilot schools on a field trial basis. ^ 

Conclusion 

reseaJoh^^a diffusion 

imovSlSr T nrl® diffusion of educational 

this piJomy ?o^f? plentiful research resources to 
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APPLYING THE PRINCIPLES OF DIFFUSION 
TO UTILIZATION OF RESEARCH 
t>y 

Roy A. Larraee 
Associate Professor 

Department of Educational Administration 
The Ohi.o State University 



I feel very fortunate to have had the opportunity to take part in the 
Research Seminar for the past four days. As a former school administrator and 
a trainer of public school administrators, I feel that you have treated us 
kindly. It has, indeed, been a learning experience for me, too. 

When Bob Taylor, Jim Christiansen, and I talked some months ago about my 
possible participation in this conference, they asked that I focus primarily on 
two specific areas. First of all, they requested me to examine Dr. Rogers' 
analysis of diffusion research; and secondly, they asked that I focus on some 
very practical problems involved in the diffusion of research. To quote 
directly from those conversations, *'What are the nuts and bolts issues involved 
in the diffusion of research?" This I am happy to atten5)t, for as we examine 
past innovation efforts, we often find that this is the area where we have been 
least successful — the area where we have done so very little to exchange tradi- 
tional methods for creative new approaches to the problem. 

Even the most cursory examination of recent legislation which provides for 
the funding of new research efforts reveals evidence of conscious concern for 
the diffusion of research on the part of framers of this legislation. It is 
also interesting to note that this concern for diffusion is not restricted to 
Siny one field or subject-matter area. In this sense, these new efforts repre- 
sent a commendable departure from the traditional. Clearly, the challenge has 
been presented and funds in amounts not formerly available in education are 
potentially at the disposal of those who are interested in initiating planned 
change in education. 

While I have been asked to focus on a specific area in the conference, I 
would like to take the liberty to draw upon a number of the presentations 
which have been made this week in addition to the pointed references in the 
presentation made by Dr. Rogers this morning. I have also been requested to 
allow you a very anqple period for questions. Initially, I would like to draw 
heavily on the Lee, Brickell, and finally the Rogers' presentations. 

Dr. Rogers has pointed to the fact that we have spent tremendous resources 
in education in developing educational innovations and additional thousands of 
dollars in inducing local schools to adopt them, yet as a serious student of 

he is able to identify only one United States educational researcher 
who has devoted all of his time to the scientific study of how these new 
educational ideas diffuse . I believe that we do have some modem examples 
of successful rapid diffusion of educational innovation, but I would have to 



agree that systematic scientific study of even these dramatic innovations is not 
available to the student of change. As one illustratipn, I would like to make 
some reference to some programs that have been widely adopted in the United 
States in a relatively short time. I refer specifically to the Course Content 
Improvement Programs of the National Science Foundation. These include such 
prr grams as the Physical Science Study Committee's secondary school physics 
program, the School Mathematics Study Group's program in elementary and secondary 
mathematics, and the Biological Sciences Curriculum Study Program in high school 
biology. These are recent programs, introduced during the past seven years, and 
their adoptions by school systems have been at a rate which surpassed the intro- 
duction of any past innovations in American education. In the case of P.S.S.C, 
for exan5)le, we find that in a period of five years, this program has moved 
from introduction in seven schools to an estimated use by 40 per cent of all 
students electing high school physics. In its second experimental year, with 
materials clearly labeled as "experimental," over 500 teachers and 50,000 stu- 
dents used the B.S.C.S. biology materials in 35 states— indeed a test eroun of 
major significance. 

Dr. ^Rogers has given you some figures on rate of adoption of new programs 
which he has labeled modern mathematics." In one of these programs. Dr. E. G. 
Begle, Director of the School Mathematics Study Group, stated that in a two-year 
period over six hundred thousand S.M.S.G. textbooks were purchased for use in 
grades 7 through 12, within five years after the initial introduction of the 
materials. Certainly we have in these and other similar programs ample evidence 
of a new adoption rate in American education. If we examine the literature 
relative to evidence of diffusion research related to these programs, we find 
little in the way of careful analysis. If, on the other hand, we examine the 
programs themselves, their planning and development procedures, thexr provi- 
sion of resources for testing, revising and dissemination, we can observe 
concrete evidence of new approaches which they have utilized. Here we find 
ample recognition of the fact that planning stages require many diverse talents, 
provision for long-term coordination, stimulation and appraisal activities and 
lastly the allocation of resources commensurate \n.th the task undertaken. Much 
remains^to be done in terms of diffusion research on these new National Science 
programs and on others that have been undertaken since these initial 
efforts were pioneered by scientists and mathematicians. 

research reported to you this morning has supported the fact 
that recent innovations have enjoyed an increasingly rapid rate of change. 

He suggests that this increase in adoption rate may be due to "the ethos of 
+4,5^^^ sputnik era," in5)roved travel, mass communication, more professional 
staff and differences in the innovations themselves. In his review of 732 
i^oyations, he has pointed to the "amazing similarity of findings of each 

of six major research traditions" as they pertain to the diffusion of 
innovations . 

I reflect on the excellent presentations which have been made during 
these past four days, it would appear that we have some implied areas of agree- 
ment which are worth noting at this point. 



1. In a number of ways we have clearly implied and agreed that 
research and development is not the exclusive domain of any 
one agency, group, or institution. 

We have alluded to the roles of the state departments of education, the 
colleges and universities, the United States Office of Education, as well as 
local school systems. We have identified the necessity for involvement of 
these groups, and we have also pointed to the need for imaginative nevf plans 
to provide for the coordination of the efforts of these agencies. Making 
resources and personnel available in adequate amounts and at the desired 
times in order to move from the initial research effort to the successful 
diffusion and adoption of appropriate findings of this research has been 
given attention by a number of the seminar speakers. 

2. There is no single best way to carry through the research, 
development, field testing and dissemination activities 
involved in innovation. 

One of our problems is to make certain that we examine all of the possible 
alternatives and choose the one most appropriate to the task we have outlined 
for ourselves. One of the problems in making a choice from among a number of 
alternatives is that of assessing the forces with which we must ultimately deal 
if the innovation is to become widely adopted. One agency which we haven’t 
mentioned very often during this conference is the professional organization. 

In most cases, it is not a single professional organization, for if we consider 
all phases of research and development, we find a number of identifiable 
professions present at various points in the research and development process. 
Let's take one example here — P.S.S.C, 

At the initiation of this project the P.S.S.C, group worked closely with 
the American Institute of Physics, the American Association of Physics Teachers, 
and the National Science Teachers Association. While I do not have time here to 
describe the specific types of involvement in each case, I would like to make 
three points. 

a. These professional groups were involved very early in the 
formative stages of the project. 

b. A sincere effort was made to include their concerns in any 
proposed new program. 

c. They continued to be active as the program developed. 

Another evidence of a new type of activity on the part of a professional 
education group can be observed in the activities of the American Association 
of School Administrators over the past ten years — activities which have 
significant implications for the adoption of innovation at the local school 
level. This is indeed a factor to be considered if we concur with Dr. Brickell 
in the inportance of the administrator as an inhibitor or facilitator of 
innovation. The A.A.S.A. has initiated a program which is designed to give 



the practicing administrator some voice in the selection of persons to be 
trained as school a^nistrators,and this professional organization has also 
developed an accreditation plan which results in the profession* s having some 
voice in the content of the program designed for training educational 
administrators . 



pother professional activity which has only begun to be a factor which 
must be considered in the research and development process is the relationship 
of teachers, school board members, professional organizations, and state 
legislatures in this expanding new area of professional negotiation and 
collective bargaining. New and strikingly more con5)rehensive contracts are 
being written in this area and professional organizations are taking strong 
stands as is evident in New York, Utah, and Oklahoma. One of the most crucial 
questions and one which concerns the topic of our seminar is— What areas are 
appropriate for negotiation? Even the most cautious observer would have to 
admit that the scope of negotiable items is being broadened. In one maior 
agreement for ex^ple, in addition to the traditional areas of salary, welfare 
and working conditions, the following topics have also been agreed upon as 
negotiable items by the parties to the contract: 

a. General objectives and long-term educational goals. 

b. Recruitment of qualified teachers. 

c. The improvement of difficult schools. 

d. The reduction of class size. 

e. The development of a more effective curriculum. 

The extent to which the last area is implemented could have serious impli- 
cations for the diffusion process. 



. other references supporting the profession as a force to be utilized 

in the area of diffusion could be identified but time does not permit. 



3. Another area of concern during the past four days of cur 
seminar could probably be sum m arized by stating that con- 
ditions affecting research, development and dissemination 
vary from state to state, but in each case there are con- 
ditions which impinge on the program, and these conditions 
or forces must be dealt with in some v/ay if innovation is 
to be successful. 



If I may, I would- like to make two observations relative to this point. 

a. The types of conditions which face the innovator will vary 
not only from geographical area to area but also variations 
will occur as we move from one content area to the other. 



b» Whil 6 1^11686 conditions will not, in some csisosj inipingo on 
th .6 innovation until it reaches the dissemination stage, 
they need to be planned for in the earlier stages of research 
and development. 

Let me use P.S.S.C, as an e 3 qan 5 )le. One of the conditions which P.S.S.C. 
had to deal with early in the planning stages of its program was the relation- 
the College Entrance Examination Board's achievement test in the area 
of physics. This examination has assumed an ever increasing importance in the 
area of college admission. The designers of the P.S.S.C. program took the 
position that a new selection of content for a program in high school physics 
would necessitate some revision in the examination designed to measure achieve- 
ment in the program. In its initial year the P.S.S.C. and the College Entrance 
Examination Board issued a joint written statement on the interpretation of 
C.E.E.B. physics test scores for those students enrolled in the P.S.S.C. program. 
A copy of this letter was sent to all colleges and universities to which P.S.S.C. 
students applied for admission. Later an alternate C.E.E.B. physics examination* 
was developed for P.S.S.C. students and finally the C.E.E.B’. examination was 
modified to include appropriate P.S.S.C. materials. 

Moving to the nuts and bolts" phase of dissemination we can also note some 
other provisions in this program which helped to speed dissemination of the 
innovation. 

a. Initially, free textbooks were furnished to the early schools 
which participated. This had in^Jlications when we consider 
adoption plans, book rental programs, and other textbooks 
arrangements prevalent in schools across the country. 

b. Free nevjly designed achievement tests were also furnished. 

c. In some cases new laboratory materials were made available to 
schools without cost--this might be a factor in a school system 
which has just built and equipped a new schoo], but would like 
to participate' in the new program. 



Even a hasty examination of factors such as those mentioned above will 
illustrate the fact that these conditions will vary as we move from geographical 
area to area and as we move from one content area to another. 

I don t think that we have mentioned any subject more frequently during 
this seminar than we have the need for adequate and diversified staff as we 
consider the research and development process. 

4 . We seem to agree that in the research and development effort 
there is a need for an adequate staff with many different 
competencies, drawn from diverse societal agencies and that 
these diverse resources need to be placed in new and unique 
relationships. 
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Personally, I believe that this is our most serious problem as we con- 
template mounting significant research and development efforts. Many argue that 
if we were to carefully assess the talent available and the challenge being 
presented in terms of support which is now visible, we need not only to develop 
imaginative plans for utilizing resources presently available in all disciplines, 
but we also must face the task of training new people; and we must, in the planning, 
phases of our programs, provide resources commensurate with the task. 

We can note some new innovations here if we again examine some of the new 
programs mentioned above. These progrsms have not depended upon the traditional 
methods for diffusing innovation, Rogers makes the point earlier that "innova- 
tions adopted by social systems rather than by individuals are likely to have a 
slower rate of adoption," Traditionally innovation has been carried out in 
isolated areas. Innovations have been designed, tested, demonstrated, and then 
recorded in professional journals. The innovation sites are subsequently visited 
and sometimes the program or portions of the program have been adopted by the 
visitors. Publishers ana developers of material recognize the innovation and it 
may then be included for wider distribution. 

It is interesting to note the departure from this procedure which was 
followed by the developers of the Course Content Improvement Programs of The 
National Science Foundation. In the initial stages experimenters (teachers) 
were very carefully selected. No one was allowed to use these materials without 
careful screening and then a significant training program was developed for 
every participant. In the ensuing phases, these initial innovators were further 
screened and those who survived this screen were utilized to train an ever 
expanding group of participants. Gradually, the new materials were also included 
in pre-service training programs for new teachers. When we assess the total cost 
of these programs, we note that a considerable allocation of resources utilized 
by these programs were used for training purposes. These groups utilized all 
available talent but committed themselves to training additional staff to insure 
a. fair trial of the new materials by persons con^etent to use these new programs. 
This would appear to be a significant departure when we consider the in^lications 
for the future of carefully developed innovations if they are introduced by 
persons not properly trained to utilize them. We must then allocate resources 
appropriate to the task. If a six-week institute is necessary for training 
purposes, let's not try and do the job with a drive-in conference or a two- 
or three-day vrorkshop. It is also important to point out here that our training 
responsibilities are not related exclusively to the dissemination stages. Our 

needs at the research and development stage are also significant and the supply 
is short. 



5. While the types of talent needed vary greatly in the various 
stages of research and development, there is a need to include 
representatives from all of the various talents in the early 
stages of planning. 

In recent innovations, a recognition of this principle is often visible in 
the conqposition of the initial steering or planning committee. While each 
individual stage will require a predominance of one type of skill or talent, 
consideration must also be given at each of these points to phases which will 




follow. Some recognition of this principle is evident if we examine the 
coii5)osition of the steering or planning committees used by the N.S.F, Course 
Content programs which have spread so rapidly. Representatives from profes- 
sional organizations, publishing houses, communications media, testing 
agencies, and business and industry are new additions to planning units in 
education. Implications for the total planning task in terms of conditions 
and forces pertinent to the research and development phases of innovation 
appear to have been included at the very outset irl thdse new programs. 

In this connection, it was also encouraging to note some comments made by 
Dr. Cuba earlier in this seminar. A first-rate researcher in his own right, 
he recommended the utilization of public school personnel at the problem 
definition and research levels. He pointed to a great untapped resource here. 
In addition to the research competencies which can be found in some public 
school personnel, their inclusion in the early phases of the reseairh and 
development process enable them to provide double service as their contribu- 
tions to dissemination activities are equally important. Many of the problem 
areas appropriate for research and development efforts are often visible to 
school personnel long before they become apparent to the agencies traditionally 
concerned with research and development activities. A dramatic case in point 
is the recent attention given to the need for new programs for the culturally 
deprived. Public schools were dealing with problems associated with cultural 
deprivation long before colleges and universities recognized the need for 
developing new programs and altering their teacher training experiences. 

If we are willing to concede the need for a great variety of talent in 
the initial planning stages and in the phases which follow, we need also to 
consider potential in5)act of these staffing implications on the agencies which 
furnish the personnel. Again problems vary a great deal as we examine the 
different agencies which might contribute personnel. First of all, when we 
select personnel and make assignments, we must make certain that the assign- 
ment is a reasonable and a realistic one. In so many cases, responsibilities 
are added to persons ■who already have a full load without removing any of 
these responsibilities. In other cases, we have not maximized the contribu- 
tion which the project can make to the agency from which the person has been 
drawn. In other cases we innocently create problems for the institution. 

From the university point of view, I can point to a niuDber of problems created 
by full-time involvement in a project. In some cases when we remove an out- 
standing person from his area in a university staff, we ten^orarily at least 
remove one of the university's most valuable resources. Students who have 
been attracted to the university to study with this person find that he is 
no longer available to them. The removal of a person for a two- or three-year 
period thus makes a major in5)act on the program. In other cases, full-time 
involvement of project staff can have undesirable effects which tfend to 
isolate the project and thus reduce the potential impact of the project as it 
relates to the on-going program of the institution. Carl Schaefer offered one 
possibility here by suggesting the appointment of two persons each on' a half- 
time basis to the project and the replacement of these two half-time positions 
through the appointment of an additional person on a full-time basis. In this 
way, maximum stimulation can be provided for both the project and the on-going 
program of the university or other cooperating agency. In the field of public 
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schools we have only scratched the surface in terms of the possibilities avail- 
able in extended summer contracts for personnel and released time arrangements. 

In the comments outlined above, I have tried to react toi.the five steps in 
the innovation process pos'tulated by Dr. Rogers. I have tried to examine the 
environmental or field of forces within which both the social system and the 
individual relate to the innovation process from awareness to adoption, I would 
tend to agree that the rate of adoption varies considerably from one idea to 
another. The properties of an innovation may affect its rate of adoption, but 
1 am not certain whether this variation in adoption rate is due to its perceived 
complexity as viewed by the potential adopter or the use of common dissemination 
techniques regardless of the corplexity of the innovation. We may not have had 
the resources available commensjirate with the tasks we have undertaken. We may 
also not have been ab’^.e to think "big enough" because of prior conditioning. 

For example, how many of us would have conceived a new high school physics 
program that would require $7j000,000 to develop and disseminate — back in 1956 . 

As I attempted to review and react to Dr. Rogers* six implications for 
change agents, I found myself in general agreement but . somewhat concerned that 
all implications might not be clear to the casual reader,, So much is included 
in each of these statements. In the materials presented above, an attenqpt has 
been made to both react to and amplify these implications. 

In selecting "good" innovations for example, what criteria does the "gate- 
keeper" use?' Which ones is he free to use?* ’Which ones are imposed upon, him by 
the social system of which he is a part? Some are local, some are regional, • 
soiT'. are national. What kinds of resources do we need to develop and dissemi- 
nate the innovation? When we speak of developing the ability of clients to 
evaluate innovations, we are outlining a tremendous task. It may have to be 
done once by one group at the national level for example and then again al;, 
the local level. Dr. Rogers pointed to the necessity for basing programs on 
needs as we identify the varying needs of local public school systems in terms 
of purposes and goals of these institutions we immediately build in requirements 
which must be recognized and planned for. 

The definition of the innovation package or the packaging of innovations 
may be restricted to the typical marketing definition of that term, as may 
choose to include in the "package" much of the planning research, development 
and dissemination activity as our definition of the total "package." The 
"package" is very different as we move from one definition to the other. 

I have tried to expand a bit on Dr. Rogers* opinion leader categories to 
include agencies which perform an important role in developing educational 
opinion groups such as colleges and universities testing agencies, publishers, 
professional organizations, state departments, ana accrediting agencies. Again 
let me underscore how much these influences of opinion vary as we move from 
area to area. 



In anticipating the consequences of innovation, we have pointed to the 
need for careful appraisal and also for the inclusion of persons capable of 
assessing the consequences of innovation at the conceptual, design and 
planning stages of the innovation. 

I found Dr. Rogers* paper most helpful in providing a framework on 
which to hang some of ray concerns and observations relative to the change' 
process and more specifically the diffusion process. It has been a most 
stimulating e:q)erience for me to take part in your seminar, I would 
like to again thank those who made it possible. 



